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(57) Abstract: A graphical user interface on a display device for using a computer to communicate using an avatar includes an 
instant message sender display. The instant message sender display includes a sender portion that displays a sender avatar capable 
of displaying multiple animations. The sender avatar is animated in response to a trigger related to content of a message sent from 
a sender to a recipient and may be animated to send to another user an out-of-band communication that conveys information inde- 
pendent of information conveyed directly in the text message sent. An avatar also may be included in one or more of multiple online 
personas enabled for a user an instant messaging communications session. An avatar may be animated in response to the animation 
of another avatar in the same communications session. 
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USING AVATARS TO COMMUNICATE 

TECHNICAL FIELD 

This description relates to projecting a graphical representation of a 
communications application operator (hereinafter "sender") in communications sent 
in a network of computers. 

BACKGROUND 

Online services may provide users with the ability to send and receive instant 
messages. Instant messages are private online conversations between two or more 
people who have access to an instant messaging service, who have installed 
communications software necessary to access and use the instant messaging service, 
and who each generally have access to information reflecting the online status of 
other users. 

An instant message sender may send self-expression items to an instant 
message recipient. Current implementations of instant messaging self-expression 
enable a user to individually select self-expression settings, such as a Buddy Icon and 
a Buddy Wallpaper, which settings thereafter project to other users who see or interact 
with that person online. 

SUMMARY 

A graphical user interface on a display device of a computer enables 
communications using an avatar. The graphical user interface includes an instant 
message sender display. The instant message sender display has a sender portion that 
displays a sender avatar capable of displaying multiple animations. The instant 
message sender display also has a message compose area capable of displaying text 
included in the message sent from the sender to the recipient and communication 
controls. At least one communication control is operable to receive an indication that 
the message displayed in the message compose area is to be sent from the sender to 
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the recipient. The sender avatar is animated in response to a trigger related to content 
of a message sent from a sender to a recipient. 

Implementations may include one or more of the following features. For 
example, the instant message sender display may include a recipient portion that 
displays a recipient avatar and a message history area. The recipient avatar may be 
capable of displaying multiple animations in response to a trigger related to content of 
a message sent from a sender to a recipient. The message history area may be capable 
of displaying the content of multiple messages sent between the sender and the 
recipient and identifying an identity associated with the recipient. The recipient avatar 
is animated in response to an animation of the sender avatar. 

The graphical user interface may include a contact list display for displaying 
potential recipients. The contact list display may indicate whether each potential 
recipient is available to receive a message. The potential recipients may be grouped 
and associated with an indication of a group identity. 

A potential recipient displayed on the contact list may be associated with a 
potential recipient avatar The potential recipient avatar may be displayed on the 
contact list in association with an identity of the potential recipient. The potential 
recipient avatar may be animated on the contact list in response to animation of the 
potential recipient avatar displayed elsewhere. The animation of the potential 
recipient avatar on the contact list may include an animation that is substantially 
similar to, or different than, the animation of the potential recipient avatar displayed 
elsewhere. The animation of the potential recipient avatar on the contact list may 
include an animation that is representative of the animation of the potential recipient 
avatar displayed elsewhere. 

The graphical user interface may be a graphical user interface that is used for 
an instant messaging communication session. The trigger comprises a portion or all 
of the text of the message. 

The appearance or animation of the sender avatar may indicate an 
environmental condition, a personality characteristic associated with the sender, an 
emotional state associated with the sender, a setting characteristic or an activity 
associated with the sender. 
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The sender avatar may be animated in response to the passing of a 
predetermined amount of time during which the sender does not communicate a 
message to the recipient or during which the sender does not use a computing device 
that is used by the sender to communicate with the recipient in the communications 
5 session. 

The avatar animation used as the communication conduit may include a 
breakout animation that involves displaying avatar outside of normal display space 
occupied by the avatar. The sender avatar may be animated to produce sounds used 
for verbal communication. 
10 Implementations of the techniques discussed above may include a computer 

program product for generating a graphical user interface, a graphical user interface 
configured for presentation on a display device, or a system or apparatus. 

In another general aspect, communicating includes graphically representing, 
with an avatar capable of being animated, a first user in a communication session. 
1 5 involving the first user and a second user. A message is communicated between the 
first user and the second user. The message conveys explicit information from the 
first user to the second user. Out-of-band information is communicated to the second 
user using a change in the avatar appearance or avatar animation as a communication 
conduit. The out-of-band communication includes a communication that is related to 
20 a context of the first user and that differs from the information conveyed in the 
message sent between the first user and the second user. 

Implementations may include one or more of the following features. For 
example, the communication session may be an instant messaging communication 
session. The avatar may be a facial animation that does not include a body having an 
25 ear or a leg or may be a facial animation, including a neck, that does not include a 

body having an ear or a leg. 

The out-of-band information may include information indicating an 
environmental condition associated with the first user. The environmental condition 
may include an environmental condition related to weather occurring in a geographic 
30 location near the first user. The out-of-band information may indicate a personality 
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characteristic associated with the first user or an emotional state associated with the 
first user. 

The out-of-band information may include information indicating a setting 
characteristic associated with the first user. The setting characteristic may include a 
5 characteristic related to time of day of the first user or a characteristic related to time 
of year. The time of year may include a holiday or a season that is one of spring, 
summer, fall or winter. The setting characteristic may include a characteristic 
associated with a work setting or a recreation setting. The recreation setting may 
include a beach setting, a tropical setting or a winter sport setting. 

10 The out-of-band information may include information related to a mood of the 

first user. The mood of the first user may be one of happy, sad or angry. 

The out-of-band information may include information associated with an 
activity of the first user. The activity may be performed by the first user at 
substantially the same time that the out-of-band message is communicated from the 

15 first user to the second user. The activity may be working or listening to music. The 
out-of-band information may include infonnation conveying that the first user has 
muted sounds associated with the avatar. 

An animation of the avatar to convey the out-of-band information from the 
first user to the second user may be triggered based on the information conveyed in 

20 the message from the first user to the second user. The trigger may include a portion 
or all of the text of the message. The trigger may include an audio portion of the 
message. The trigger may include the passing of a predetermined amount of time 
during which the first user does not communicate a message to the second user or 
does not use a computing device that is used by the first user to communicate with the 

25 second user in the communication session. 

The avatar animation used as the communication conduit may include a facial 
expression of the avatar, a gesture made by a hand or arm of the avatar, movement of 
a body of the avatar or sounds made by the avatar. At least some of the sounds may 
include a voice based on a voice of the first user. The avatar animation used as the 

30 communication conduit may include a breakout animation that involves displaying 
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avatar outside of normal display space occupied by the avatar. A breakout animation 
may include telescoping, resizing, or repositioning the avatar. 

The first user may be provided with multiple preconfigured avatars having 
associated preselected animations. The first user may be enabled to select a particular 
5 avatar to represent the user in the communications session. The first user may be 

persistently associated with the selected avatar to represent the first user in subsequent 
communication sessions. 

The first user may be enabled to modify the appearance of the avatar. 
Enabling the first user to modify the appearance of the avatar may include enabling 
10 the first user to use a slide bar to indicate a particular modification of a particular 
feature of the avatar or enabling the first user to modify appearance of the avatar to 
reflect a characteristic of the first user. The characteristic of the first user may be one 
of age, gender, hair color, eye color, or a facial feature. 

Enabling the first user to modify the appearance of the avatar may include 
15 enabling the first user to modify the appearance of the avatar by adding, changing or 
deleting a prop displayed with the avatar. A prop may be one of eyeglasses, 
sunglasses, a hat, or earrings. 

The first user may be enabled to modify a trigger used to cause an animation 
of the avatar. The trigger may include text included in the message sent from the first 
20 user to the second user. 

The avatar may be animated for use as an information assistant to convey 
information to the first user. Use of the avatar by an application other than a 
communications application, including an online j ournal, may be enabled. 

A depiction of the avatar may be displayed in the form that is substantially 
25 similar to a trading card. The trading card depiction of the avatar may include 
characteristics associated with the first user. 

In yet another general aspect, perception of multiple online personas is 
enabled in an instant messaging communications session. At least two identities 
within a communications environment to whom messages may be directed are 
30 identified. A first persona of a user is enabled to be projected to a first of the 
identities while a second persona of the same user is enabled to be concurrently 
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projected to a second of the identities. The first and second personas each include an 
avatar capable of being animated, and the first persona and the second persona differ. 

Implementations may include one or more of the following features. For 
example, the first persona may differ from the second persona such that first persona 
5 invokes a different avatar than an avatar invoked by the second persona. 

The first persona may invoke a first avatar, and the second persona may 
invoke a second avatar. The first avatar and the second avatar may be the same 
avatar. An animation associated with the first avatar may be different from 
animations associated with the second avatar. An appearance associated with the first 

10 avatar may be different from appearances associated with the second avatar. 

An avatar may be associated with multiple sounds. An avatar may be capable 
of being animated based on text of a message sent in the instant message 
communications session. An avatar also maybe capable of being animated to send an 
out-of-band communication. 

1 5 The first persona may be associated with a first group of identities so that the 

first persona is projected in communications sessions with members of the first group 
of identities. The second persona may be associated with a second group of identities 
so that the second persona is projected in communications sessions with members of 
the second group of identities. 

20 A persona may be associated with the first of the identities, and a different 

persona may be associated with a group of the identities with which the first of the 
identities is associated. The first persona projected to the first of the identities may be 
an amalgamation of the persona associated with the first of the identities and the 
different persona associated with the group of the identities. The persona associated 

25 with the first of the identities may override the different persona associated with the 
group of the identities to the extent a conflict exists. 

In still another general aspect, perception of multiple online personas is 
enabled in an instant messaging communications session. An instant messaging 
application user interface for an instant messaging communications session is 

30 rendered on an instant messaging recipient system. The communications session 
involves at least one potential instant messaging recipient and a single potential 

6 
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instant messaging sender. A message is sent that includes a text message and a 
persona. The persona is selected among multiple possible personas associated with 
the instant messaging sender to be displayed by the potential instant messaging 
recipient when displaying the text message. The selected persona includes a 
5 collection of one or more self-expression items and a sender avatar capable of being 
animated. The selected persona is rendered at the potential instant messaging 
recipient system when rendering another portion of the message. 

Implementations may include one or more of the following features. For 
example, the sender persona may be selected by the instant messaging sender from 

10 the multiple possible personas associated with the instant messaging sender. The 

persona may be rendered before or after communications are initiated by the potential 
instant messaging sender. The self-expression items may include one or more of a 
wallpaper, an emoticon, and a sound. One or more personas may be defined. 

A first persona may be assigned to a first potential instant messaging recipient 

15 so that the first persona is thereafter automatically invoked and projected in an instant 
messaging communications session involving the first potential instant messaging 
recipient. A second persona may be assigned to a second potential instant messaging 
recipient so that the second persona is thereafter automatically invoked and projected 
in an instant messaging communications session involving the second potential instant 

20 messaging recipient. The second persona may be at least partially distinguishable 
from the first persona. 

A first persona may be assigned to a first group of potential instant messaging 
recipients so that the first persona is thereafter automatically invoked and projected in 
an instant messaging communications session involving a member of the first group 

25 of potential instant messaging recipients. A second persona may be assigned to a 
second potential instant messaging recipient so that the second persona is thereafter 
automatically invoked and projected in an instant messaging communications session 
involving the second potential instant messaging recipient. The second persona may 
be at least partially distinguishable from the first persona. 

30 The use of one of the multiple personas may be disabled. Disabling the use of 

one of the multiple personas may be based on the instant messaging recipient. 

7 
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One of the multiple personas may be a work persona associated with presence 
of the instant messaging sender at a work location associated with the instant 
messaging sender. One of the multiple personas may be a home persona associated 
with presence of the instant messaging sender at home. A determination may be made 
5 as to whether the instant messaging sender is at home or at the work location. In 
response to a determination that the instant messaging sender is at home, the home 
persona may be selected for use in the instant messaging communications session. In 
response to a determination that the instant messaging sender is at the work location, 
the work persona may be selected for use in the instant messaging communications 
10 session. 

A persona to be displayed may be selected by the potential instant messaging 
recipient based on time of day, day of week, or a group of potential instant messaging 
recipients that are associated with the potential instant messaging recipient. 

At least some of characteristics of a persona may be transparent to the instant 
1 5 messaging sender. The sender avatar may be animated to send an out-of-band 

communication from the instant messaging sender to the potential instant messaging 
recipient. 

In yet another general aspect, an avatar is used to communicate. A user is 
represented graphically using an avatar capable of being animated. The avatar is 

20 associated with multiple animations and multiple features of appearance that represent 
a pattern of characteristics representing a personality of the avatar. 

Implementations may include one or more of the following features. For 
example, the avatar may be associated with a description that identifies the 
personality of the avatar. The personality of the avatar may include at least some 

25 characteristics that are distinct of at least some characteristics of a personality of the 
user. A second user may be graphically represented with a second avatar capable of 
being animated. The second avatar may be associated with multiple animations and 
multiple features of appearance that represent a pattern of characteristics representing 
a personality of the second avatar. The personality of the second avatar may include 

30 at least some characteristics that are distinct of at least some characteristics of the 

8 
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personality of the first avatar. Communication messages may be sent between the 
first user and the second user. 

In yet another general aspect, a first avatar is animated based on perceived 
animation of a second avatar. A first user is graphically represented with a first avatar 
5 capable of being animated, and a second user is graphically represented with a second 
avatar capable of being animated. Communication messages are being sent between 
the first user and the second user. An indication of an animation of the first avatar is 
received, and, the second avatar is animated in response to, and based on, the received 
indication of the animation. 

10 Implementations may include one or more of the following features. For 

example, the indication of an animation received may be any type of animation of the 
first avatar or may be an indication of a particular animation of multiple possible 
animations of the first avatar. The first avatar may be subsequently animated in 
response to and based on the animation of the second avatar. 

15 The first avatar may be animated in response to a particular portion of a 

message sent between the first user and the second user. The message may be sent 
from the first user to the second user or may be sent to the first user from the second 
user. The first avatar may be animated to send an out-of-band communication from 
the first user to the second user* 

20 Implementations of the techniques discussed above may include a method or 

process, a system or apparatus, or computer software on a computer-accessible 
medium. 

The details of one or more of the implementations are set forth in the 
accompanying drawings and description below. Other features will be apparent from 
25 the description and drawings, and from the claims. 



DESCRIPTION OF DRAWINGS 

FIGS. 1, 2 and 5 are diagrams of user interfaces for an instant messaging 
service capable of enabling a user to project an avatar for self-expression. 
30 FIG. 3 is a flow chart of a process for animating an avatar based on the content 

of an instant message. 

9 
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FIG. 4 is a block diagram illustrating exemplary animations of an avatar and 
textual triggers for each animation. 

FIG. 6 is a diagram illustrating an exemplary process involving 
communications between two instant messaging client systems and an instant 
5 message host system, whereby an avatar of a user of one of the instant message client 
systems is animated based on the animation of an avatar of a user of the other of the 
instant message client systems. 

FIG. 7 is a flow chart of a process for selecting and optionally customizing an 

avatar. 

10 FIG. 8 is a block diagram depicting examples of avatars capable of being 

projected by a user for self-expression. 

FIG. 9 is a diagram of a user interface for customizing the appearance of an 

avatar. 

FIG. 10 is a diagram of a user interface used to present a snapshot description 
15 of an avatar. 

FIG. 1 1 A is a block diagram illustrating relationships between online 
personas, avatars, avatar behaviors and avatar appearances. 

FIG. 1 IB is a flow chart of a process for using a different online personality to 
communicate with each of two instant message recipients. 
20 FIG. 12 is a diagram of a user interface that enables an instant message sender 

to select among available online personas. 

FIG. 13 is a diagram of exemplary user interfaces for enabling an instant 
message sender to create and store an online persona that includes an avatar for self- 
expression. 

25 FIG. 14 is a flow chart of a process for enabling a user to change an online 

persona that includes an avatar for self-expression. 

FIG. 1 5 is a flow chart of a process for using an avatar to communicate an out- 
of-band message to an instant message recipient. 

FIGS. 16, 17 and 18 are diagrams of exemplary communications systems 
30 capable of enabling an instant message user to project an avatar for self-expression. 

10 
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DETAILED DESCRIPTION 

An avatar representing an instant messaging user may be animated based on 
the message sent between a sender and recipient. An instant messaging application 
5 interface is configured to detect entry of predetermined or user-defined character 
strings, and to relate those character strings to predefined animations of an avatar. 
The avatar representing or selected by the sender is animated in the recipient's instant 
messaging application interface and, optionally, in the sender's instant messaging 
application interface. The avatar is rendered based on an animation model including a 

10 mesh that defines, using polygons, the form of the avatar, a texture defines an image 
to covers the mesh of the avatar, and a light map that defines the effect of a light 
source on the avatar. The animation model for the avatar includes particular 
geometry, including at least one thousand polygons in the underlying wire model that 
makes up the avatar's mesh, and at least twenty blend shapes, each of which defines a 

15 different facial expression or shape. The animation model includes multiple 

animations capable of being rendered for the avatar defined by the animation model 
and the animations being capable of association with one or more sound effects. The 
animation model for the avatar may include only a face and/or a face and neck of the 
avatai\ 

20 An avatar representing a user in a communications session also may be used to 

send to another user an out-of-band communication that conveys information 
independent of information conveyed directly in the text message sent. The out-of- 
band information may be communicated using a change in the avatar appearance or 
avatar animation as a communication conduit. By way of example, an out-of-band 

25 communication may include information about the sender's setting, environment, 
activity or mood, which is not explicitly communicated and part of a text message 
exchanged by a sender and a recipient. 

A user may name and save multiple different "online personas" or "online 
personalities," which are groups of instant messaging self-expression settings such as, 

30 for example, avatars, Buddy Sounds, Buddy Wallpaper and Emoticons (e.g., 

Smileys). Then, depending on the identity with whom the user communicates, they 
may access and project a preselected one of their online personas in an instant 

11 
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messaging environment, and or they may manually invoke and manage the online 
persona they project to others. Functionality and features of the instant messaging 
interface may differ based upon the online personas being used in the instant message 
conversation. 

5 An avatar that represents a user in a communications session may be 

animated, without user manipulation, based on the animation of another avatar that 
represents another user in the same communications session. This may be referred to 
as an automatic response of an avatar to the behavior of another avatar. 

FIG. 1 illustrates an exemplary graphical user interface 100 for an instant 

10 messaging service capable of enabling a user to project an avatar for self-expression. 
The user interface 100 may be viewed by a user who is an instant message sender and 
whose instant messaging communications program is configured to project an avatar 
associated with and used as an identifier for the user to one or more other users or 
user groups (collectively, instant message recipients). In particular, the user 

15 IMS end er is an instant message sender using the user interface 100. The instant 

message sender proj ects a sender avatar 135 in an instant messaging communications 
session with an instant message recipient SuperBuddyFanl, who projects a recipient 
avatar 115. A corresponding graphical user interface (not shown) is used by the 
instant message recipient SuperBuddyFanl . hi this manner, the sender avatar 135 is 

20 visible in each of the sender's user interface and the recipient's user interface, as is the 
recipient avatar 115. The instant messaging communications session may be 
conducted simultaneously, near-simultaneously, or serially. 

The user interface (UI) 100 includes an instant message user interface 105 and 
an instant messaging buddy list window 170. 

25 The instant message user interface 105 has an instant message recipient 

portion 110 and an instant message sender portion 130. The instant message recipient 
portion 110 displays the recipient avatar 115 chosen by the instant message recipient 
with whom the instant message sender is having an instant message conversation. 
Similarly, the instant message sender portion 130 displays the sender avatar 135 

30 chosen by the instant message sender. The display of the sender avatar 135 in the 

instant message user interface 105 enables the instant message sender to perceive the 

12 
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avatar being projected to the particular instant message recipient with whom the 
instant message sender is communicating. The avatars 135 and 115 are 
personalization items selectable by an instant message user for self-expression. 
The instant message user interface 105 includes an instant message 
5 composition area 145 for composing instant message messages to be sent to the 
instant message recipient and for message history text box 125 for displaying a 
transcript of the instant message communications session with the instant message 
recipient. Each of the messages sent to, or received from, the instant message 
recipient are listed in chronological order in the message history text box 125, each 
10 with an indication of the user that sent the message as shown at 126. The message 
history text box 125 optionally may include a time stamp 127 for each of the 
messages sent. 

Wallpaper may be applied to portions of the graphical user interface 100. For 
example, wallpaper may be applied to window portion 120 that is outside of the 

15 message history box 125 or window portion 140 that is outside of the message 

composition area 145. The recipient avatar 1 15 is displayed over, or in place of, the 
wallpaper applied to the window portion 120, and the wallpaper applied to the 
window portion 120 corresponds to the recipient avatar 115. Likewise, the sender 
avatar 135 is displayed over, or in place of, the wallpaper applied to the window 

20 portion 140 and the wallpaper applied to the window portion 120 corresponds to the 
sender avatar 135. In some implementations, a box or other type of boundary may be 
displayed around the avatar, as shown by boundary 157 displayed around the sender 
avatar 135. A different wallpaper may be applied to window portion 158 inside the 
boundary 157 than the wallpaper applied to the window portion 140 outside of the 

25 message composition area 145 but not within the boundary 157. The wallpaper may 
appear to be non-uniform and may include objects that are animated. The wallpapers 
applied to the window portions 120 and 140 may be personalization items selectable 
by an instant message user for self-expression. 

The instant message user interface 105 also includes a set of feature controls 

30 165 and a set of transmission controls 150. The feature controls 165 may control 
features such as encryption, conversation logging, conversation forwarding to a 

13 
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different communications mode, font size and color control, and spell checking, 
among others. The set of transmission controls 150 includes a control 160 to trigger 
sending of the message that was typed into the instant message composition area 145, 
and a control 155 for modifying the appearance or behavior of the sender avatar 135. 
5 The instant message buddy list window 170 includes an instant message 

sender-selected list 175 of potential instant messaging recipients ("buddies") 180a- 
180g. Buddies typically are contacts who are known to the potential instant message 
sender (here, IMSender). In the list 175, the representations 180a-180g include text 
identifying the screen names of the buddies included in list 175; however, additional 

10 or alternative information may be used to represent one or more of the buddies, such 
as an avatar associated with the buddy, that is reduced in size and either still or 
animated. For example, the representation 180a includes the screen name and avatar 
of the instant message recipient named SuperBuddyFanl . The representations 180a- 
180g may provide connectivity information to the instant message sender about the 

1 5 buddy, such as whether the buddy is online, how long the buddy has been online, 
whether the buddy is away, or whether the buddy is using a mobile device. 

Buddies may be grouped by an instant message sender into one or more user- 
defined or pre-selected groupings ("groups"). As shown, the instant message buddy 
list window 170 has three groups, Buddies 182, Co-Workers 184, and Family 186. 

20 SuperBuddyFanl 185a belongs to the Buddies group 182, and ChattingChuck 185c 
belongs to the Co-Workers group 184. When a buddy's instant message client 
program is able to receive communications, the representation of the buddy in the 
buddy list is displayed under the name or representation of the buddy group to which 
the buddy belongs. As shown, at least potential instant messaging recipients 180a- 

25 1 80g are online. In contrast, when a buddy's instant message client program is not 

able to receive communications, the representation of the buddy in the buddy list may 
not be displayed under the group with which it is associated, but it may instead be 
displayed with representations of buddies from other groups under the heading 
Offline 188. All buddies included in the list 175 are displayed either under one of the 

30 groups 182, 184, or 186, or under the heading Offline 188. 
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As illustrated in FIG. 1, each of the sender avatar 135 and the recipient avatar 
1 1 5 is a graphical image that represents a user in an instant message communications 
session. The sender projects the sender avatar 135 for self-expression, whereas the 
recipient projects the recipient avatar 115 also for self-expression. Here, each of the 
5 animation avatars 135 or 115 is an avatar that only includes a graphical image of a 
face, which may be referred to as a facial avatar or a head avatar. In other 
implementations, an avatar may include additional body components. By way of 
example, a Thanksgiving turkey avatar may include an image of a whole turkey, 
including a head, a neck, a body and feathers. 

10 The sender avatar 135 may be animated in response to an instant message sent 

to the instant message recipient, and the recipient avatar 115 may be animated in 
response to an instant message sent by the instant message recipient. For example, 
the text of an instant message sent by the sender may trigger an animation of the 
sender avatar 135, and the text of an instant messages sent by the instant message 

15 recipient to the sender may trigger an animation of the recipient avatar 115. 

More particularly, the text of a message to be sent is specified by the sender in 
the message specification text box 145. The text entered in the message specification 
text box 145 is sent to the recipient when the sender activates the send button 160. 
When the send button 160 is activated, the instant message application searches the 

20 text of the message for animation triggers. When an animation trigger is identified, 
the sender avatar 135 is animated with an animation that is associated with the 
identified trigger. This process is described more fully later. In a similar manner, the 
text of a message sent by the instant message recipient and received by the sender is 
searched for animation triggers and, when found, the recipient avatar 115 is animated 

25 with an animation associated with the identified trigger. By way of example, the text 
of a message may include a character string "LOL," which is an acronym that stands 
for "laughing out loud." The character string "LOL" may trigger an animation in the 
sender avatar 135 or the recipient avatar 115 such that the sender avatar 135 or the 
recipient avatar 115 appears to be laughing. 

30 Alternatively or additionally, the sender avatar 135 may be animated in 

response to an instant message sent from the instant message recipient, and the 
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recipient avatar 115 may be animated in response to a message sent from the instant 
message sender. For example, the text of an instant message sent by the sender may 
trigger an animation of the recipient avatar 115, and the text of an instant messages 
sent by the instant message recipient to the sender may trigger an animation of the 
5 sender avatar 135. 

More particularly, the text of a message to be sent is specified by the sender in 
the message specification text box 145. The text entered in the message specification 
text box 145 is sent to the recipient when the sender activates the send button 160. 
When the send button 160 is activated, the instant message application searches the 

10 text of the message for animation triggers. When an animation trigger is identified, 
the recipient avatar 1 15 is animated with an animation that is associated with the 
identified trigger. In a similar manner, the text of a message sent by the instant 
message recipient and received by the sender is searched for animation triggers and, 
when found, the sender avatar 135 is animated with an animation associated with the 

1 5 identified trigger. 

hi addition, the sender avatar 135 or the recipient avatar 115 may be animated 
in direct response to a request from the sender or the recipient. Direct animation of 
the sender avatar 135 or the recipient avatar 115 enables use of the avatars as a means 
for communicating information between the sender and the recipient without an 

20 accompanying instant message. For example, the sender may perform an action that 
directly causes the sender avatar 135 to be animated, or the recipient may perform an 
action that directly causes the recipient avatar 1 15 to be animated. The action may 
include pressing a button corresponding to the animation to be played or selecting the 
animation to be played from a list of animations. For example, the sender may be 

25 presented with a button that inspires an animation in the sender avatar 135 and that is 
distinct from the send button 160. Selecting the button may cause an animation of the 
sender avatar 135 to be played without performing any other actions, such as sending 
an instant message specified in the message composition area 145. The played 
animation may be chosen at random from the possible animations of the sender avatar 

30 135, or the played animation may be chosen before the button is selected. 
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An animation in one of the avatars 135 or 1 15 displayed on the instant 
messaging user interface 1 05 may cause an animation in the other avatar. For 
example, an animation of the recipient avatar 115 may trigger an animation in the 
sender avatar 135, and vice versa. By way of example, the sender avatar 135 maybe 
5 animated to appear to be crying, hi response to the animation of the sender avatar 
135, the recipient avatar 115 also may be animated to appear to be crying. 
Alternatively, the recipient avatar 115 may be animated to appear comforting or 
sympathetic in response to the crying animation of the sender avatar 135. In another 
example, a sender avatar 135 may be animated to show a kiss and, in response, a 

10 recipient avatar 115 may be animated to blush. 

The recipient avatar 115 may appear to respond to a mood of the sender 
communicated by the sender avatar 135. By way of example, in response to a 
frowning or teary animation of the sender avatar 135, the recipient avatar 115 also 
may appear sad. Alternatively, the recipient avatar 115 may be animated to try to 

15 cheer up the sender avatar 135, such as by smiling, exhibiting a comical expression, 
such as sticking its tongue out, or exhibiting a sympathetic expression. 

An avatar 135 or 1 15 may be animated in response to a detected idle period of 
a predetermined duration. For example, after a period of sender inactivity, the sender 
avatar 135 may be animated to give the appearance that the avatar is sleeping, falling 

20 off of the instant messaging interface 105, or some other activity indicative of 

inactivity. An avatar 135 or 1 15 also may progress through a series of animations 
during a period of sender inactivity. The series of animations may repeat 
continuously or play only once in response to the detection of an idle period. In one 
example, the sender avatar 135 maybe animated to give the appearance that the 

25 avatar is sleeping and then having the avatar appear to fall off the instant messaging 
user interface 105 after a period of sleeping. Animating an avatar 135 or 115 through 
a progression of multiple animations representative of a period of sender inactivity 
may provide entertainment to the sender. This may lead to increased usage of the 
instant messaging user interface 105 by the sender, which in turn, may lead to an 

30 increased market share for the instant message service provider. 
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The sender avatar 135 or the recipient avatar 115 may be animated to reflect 
the weather at the geographic locations of the sender and the recipient, respectively. 
For example, if rain is falling at the geographic location of the sender, then the sender 
avatar 135 may be animated to put on a rain coat or open an umbrella. The wallpaper 
5 corresponding to the sender avatar 135 also may include rain drops animated to 

appear to be failing on the sender avatar 135. The animation of the sender avatar 135 
or the recipient avatar 115 played in response to the weather may be triggered by 
weather information received on the sender's computer or the recipient's computer, 
respectively. For example, the weather information may be pushed to the sender's 

10 computer by a host system of an instant messaging system being used. If the pushed 
weather information indicates that it is raining, then an animation of the sender avatar 
135 corresponding to rainy weather is played. 

Furthermore, the avatar may be used to audibly verbalize content other than 
the text communicated between parties during a communications session. For 

15 example, if the text "Hi" appears within a message sent by the sender, the sender 

avatar 135 may be animated to verbally say "Hello" in response. As another example, 
when the text "otp" or the text "on the phone" appears within a message sent by the 
recipient, the recipient avatar 115 may be animated to verbally say "be with you in 
just a minute" in response. As another example, in response to an idle state, an avatar 

20 may audibly try to get the attention of the sender or the recipient. For example, when 
the recipient sends a message to the sender that includes a question mark and the 
sender is determined to be idle, the recipient avatar 115 may audibly say "Hello? You 
there?" to try to elicit a response from the sender regarding the recipient's question. 
The sender may mute the recipient avatar 1 15 or the sender avatar 135 to 

25 prevent the recipient avatar 1 15 or the sender avatar 135 from speaking further. By 
way of example, the sender may prefer to mute the recipient avatar 1 15 to prevent the 
recipient avatar 115 from speaking. In one implementation, to show that an avatar is 
muted, the avatar may appear to be wearing a gag. 

The voice of an avatar may correspond to the voice of a user associated with 

30 the avatar. To do so, the characteristics of the user's voice may be extracted from 

audio samples of the user's voice. The extracted characteristics and the audio samples 
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may be used to create the voice of the avatar. Additionally or alternatively, the voice 
of the avatar need not correspond to the voice of the user and may be any generated or 
recorded voice. 

The sender avatar 135 may be used to communicate an aspect of the setting or 
5 the environment of the sender. By way of example, the animation and appearance of 
the sender avatar 135 may reflect aspects of the time, date or place of the sender or 
aspects of the circumstances, objects or conditions of the sender. For example, when 
the sender uses the instant messaging user interface 105 at night, the sender avatar 
135 may appear to be dressed in pajamas and have a light turned on to illuminate an 

10 otherwise dark portion of the screen on which the avatar is displayed and/or the 

sender avatar 135 may periodically appear to yawn. When the sender uses the instant 
messaging user interface 105 during a holiday period, the sender avatar 135 may be 
dressed in a manner illustrative of the holiday, such as appearing, as Santa Claus 
during December, a pumpkin near Halloween, or Uncle Sam during early July. The 

15 appearance of the sender avatar 135 also may reflect the climate or geographic 

location of the sender. For example, when rain is falling in the location of the sender, 
wallpaper corresponding the sender avatar 135 may include falling raindrops and/or 
the sender avatar 135 may wear a rain hat or appear under an open umbrella. In 
another example, when the sender is sending instant message from a tropical location, 

20 the sender avatar 135 may appear in beach attire. 

The sender avatar 135 also may communicate an activity being performed by 
the sender while the sender is using the instant messaging user interface 105. For 
example, when the sender is listening to music, the avatar 135 may appear to be 
wearing headphones. When the sender is working, the sender avatar 135 may be 

25 dressed in business attire, such as appearing in a suit and a tie. 

The appearance of the sender avatar 135 also may communicate the mood or 
an emotional state of the sender. For example, the sender avatar 135 may 
communicate a sad state of the sender by frowning or shedding a tear. The 
appearance of the sender avatar 135 or the recipient avatar 115 may resemble the 

30 sender or the recipient, respectively. For example, the appearance of the sender avatar 
135 may be such that the sender avatar 135 appears to be of a similar age as the 
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sender. In one implementation, as the sender ages, the sender avatar 135 also may 
appear to age. As another example, the appearance of the recipient avatar 115 may be 
such that the recipient avatar 115 has an appearance similar to that of the recipient. 

In some implementations, the wallpaper applied to the window portion 120 
and/or the wallpaper applied to the window portion 140 may include one or more 
animated objects. The animated objects may repeat continuously or periodically on a 
predetermined or random basis a series of animations. Additionally or alternatively, 
the wallpapers applied to the window portions 120 and 140 may be animated to in 
response to the text of messages sent between the sender and the recipient. For 
example, the text of an instant message sent by the sender may trigger an animation of 
the animated objects included in the wallpaper corresponding to the sender avatar 
135, and the text of an instant messages sent by the instant message recipient to the 
sender may trigger an animation of the animated objects included in the wallpaper 
corresponding to the recipient avatar 115. The animated objects included in the 
wallpapers may be animated to reflect the setting or environment, activity and mood 
of the recipient and the sender, respectively. 

An avatar may be used as a mechanism to enable self-expression or additional 
non-text communication by a user associated with the avatar. For example, the sender 
avatar 135 is a projection of the sender, and the recipient avatar 1 15 is a projection of 
the recipient. The avatar represents the user in instant messaging communications 
sessions that involve the user. The personality or emotional state of a sender may be 
projected or otherwise communicated through the personality of the avatar. Some 
users may prefer to use an avatar that more accurately represents the user. As such, a 
user may change the appearance and behavior of an avatar to more accurately reflect 
the personality of the user, hi some cases, a sender may prefer to use an avatar for 
self-expression rather than projecting an actual image of the sender. For example, 
some people may prefer using an avatar to sending a video or photograph of the 
sender. 

Referring to FIG. 2, the animation of an avatar may involve resizing or 
repositioning the avatar such that the avatar occupies more or different space on the 
instant message user interface 105 than the original boundary of the avatar. In the 
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illustration of FIG. 2, the size of sender avatar 205 has been increased such that the 
avatar 205 covers a portion of the message instant message composition area 145 and 
the control 155. In addition, elements of the user interface 100 other than an avatar 
also may be displayed using additional space or using different space on the user 
5 interface 100. For example, a sender avatar may depict a starfish with an expressive 
face and may be displayed on wallpaper that includes animated fish. The animated 
fish included in the wallpaper may be drawn outside the original boundary around the 
sender avatar 135 and appear to swim outside the original boundary area. 

Referring to FIG. 3 5 a process 300 is illustrated for animating an avatar for 

10 self-expression based on the content of an instant message. In particular, an avatar 
representing an instant message sender is animated in response to text sent by the 
sender. The wallpaper of the avatar also is animated. The process 300 is performed 
by a processor executing an instant messaging communications program. In general, 
the text of a message sent to an instant message recipient is searched for an animation 

1 5 trigger and, when a trigger is found, the avatar that represents the instant message 

sender is animated in a particular manner based on the particular trigger that is found. 
The wallpaper displayed for the avatar includes an animated object or animated 
objects. The object or objects may be animated based on the content of the instant 
message sent or may be animated based on other triggers, including (but not limited 

20 to) the passing of a predetermined amount of time, the occurrence of a particular day 
or time of day, any type of animation of the sender avatar, a particular type of 
animation of the sender avatar, any type of animation of the recipient avatar, or a 
particular type of the animation of the recipient avatar. Also, when the sender is 
inactive for a predetermined duration, the avatar sequentially displays each of 

25 multiple animations associated with an idle state. 

The process 300 begins when an instant message sender who is associated 
with an avatar starts an instant messaging communications session with an instant 
message recipient (step 305). To do so, the sender may select the name of the 
recipient from a buddy list, such as the buddy list 170 from FIG. 1. Alternatively, the 

30 name of the recipient may be entered into a form that enables instant messages to be 
specified and sent. As another alternative, the sender may start an instant messaging 
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application that may be used to sign on for access to the instant messaging system and 
specify the recipient as a user of the instant messaging system with which a 
communications session is to be started. Once the recipient has been specified in this 
manner, a determination is made as to whether a copy of avatars associated with the 
5 sender and the recipient exist on the instant message client system being used by the 
sender. If not, copies of the avatars are retrieved for use during the instant message 
communications session. For example, information to render an avatar of the recipient 
may be retrieved from an instant message host system or the instant message recipient 
client. In some cases, a particular avatar may be selected by the sender for use during 

10 the instant messaging communications session. Alternatively or additionally, the 
avatar may have been previously identified and associated with the sender. 

The processor displays a user interface for the instant messaging session 
including the avatar associated with the sender and wallpaper applied to the user 
interface over which the avatar is displayed (step 307). The avatar may be displayed 

15 over, for example, wallpaper applied to a portion of a window in which an instant 
message interface is displayed. In another example, the avatar is displayed over a 
portion or portions of an instant message interface, such as window portions 120 or 
140 and FIG. 1. In the example of FIG. 3, the wallpaper corresponding to avatar may 
include an object or objects that are animated during the instant message 

20 communications session. 

The processor receives text of a message entered by the sender to be sent to 
the instant message recipient (step 310) and sends a message corresponding to the 
entered text to the recipient (step 315). The processor compares the text of the 
message to multiple animation triggers that are associated with the avatar projected by 

25 the sender (step 320). A trigger may include any letter, number, or symbol that may 
be typed or otherwise entered using a keyboard or keypad. Multiple triggers may be 
associated with an animation. 

Referring also to FIG. 4, examples 400 of triggers associated with animations 
405a-405q of a particular avatar model are shown. Each of the animations 405a-405q 

30 has multiple associated triggers 410a-410q. More particularly, by way of example, 

the animation 405a, in which the avatar is made to smile, has associated triggers 410a. 
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Each of the triggers 410a includes multiple character strings, hi particular, triggers 
410a include a ":)" trigger 41 la, a ":-)" trigger 412a, a "0:-)" trigger 413a, a "0:)" 
trigger 414a, and a "Nice" trigger 415a. As illustrated, a trigger may be an English 
word, such as 415a, or an emoticon, such as 41 la-414a. Other examples of a trigger 
5 include a particular abbreviation, such as "lol" 41 In, and an English phrase, such as 
"Oh no" 415e. As discussed previously, when one of the triggers is included in an 
instant message, the avatar is animated with an animation that is associated with the 
trigger. In one example, when "Nice" is included in an instant message, the avatar is 
made to smile. In one implementation, one or more of the triggers associated with an 

1 0 animation is modifiable by a user. For example, a user may associate a new trigger 
with an animation, such as by adding "Happy" to triggers 410a to make the avatar 
smile, hi another example, a user may delete a trigger associated with an animation 
(that is, disassociate a trigger from an animation), such as by deleting "Nice" 415a. In 
yet another example, a user may change a trigger that is associated with an animation, 

15 such as by changing the "wink" trigger 413b to "winks." 

In some implementations, a particular trigger may be associated with only one 
animation. In other implementations, a particular trigger may be permitted to be 
associated with multiple animations. In some implementations, only one of the 
multiple animations may be played in response to a particular trigger. The single 

20 animation to be played may be chosen randomly or in a pre-determined manner from 
the multiple animations. In other implementations, all of the multiple animations may 
be played serially based on a single trigger. In some implementations, a user may be 
permitted to delete a particular animation. For example, the user may delete the yell 
animation 405g. hi such a case, the user may delete some or all of the triggers 

25 associated with the yell animation 405g or may chose to associate some or all of the 
triggers 410g with a different animation, such as a smile animation 405a. 

Referring again to FIG. 3, the processor determines whether a trigger is 
included within the message (step 325). When the message includes a trigger (step 
325), the processor identifies a type of animation that is associated with the identified 

30 trigger (step 330). This may be accomplished by using a database table, a list, or a 
file that associates one or more triggers with a type of animation for the avatar to 
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identify a particular type of animation. Types of animation include, by way of 
example, a smile 405a, a wink 405b, a frown 405c, an expression with a tongue out 
405d, a shocked expression 410d, a kiss 405f, a yell 405g, a big smile 405h, a 
sleeping expression 405i, a nodding expression 405j, a sigh 405k, a sad expression 
4051, a cool expression 405m, a laugh 405n, a disappearance 405o, a smell 405p, or a 
negative expression 405q, all of FIG. 4. The identified type of animation for the 
avatar is played (step 335). 

Optionally, the processor may identify and play an animation of at least one 
wallpaper object based on the match of a trigger with the text of the message sent 
(step 337). 

The processor monitors the communications activity of the sender for periods 
of inactivity (step 340) to detect when the sender is in an idle state or an idle period of 
communications activity (step 345). The sender may be in an idle state after a period 
during which no messages were sent. To detect an idle state, the processor may 
determine whether the sender has not typed or sent an instant message or otherwise 
interacted with the instant message communications application for a predetermined 
amount of time. Alternatively, an idle state may be detected by the processor when 
the sender has not used the computer system in which the processor operates for a 
predetermined amount of time. 

When the processor detects inactivity (which may be referred to an idle state), 
a type of animation associated with the idle state is identified (step 350). This may be 
accomplished by using a database table, list or file that identifies one or more types of 
animations to play during a detected idle period. The type of animations played 
during a detected idle state may be the same as or different from the types of 
animations played based on a trigger in an instant message. The identified type of 
animation is played (step 355). In one implementation, multiple types of animation 
associated with the idle state may be identified and played. When the processor 
detects that the sender is no longer idle, such as by receiving an input from the sender, 
the processor may immediately stop playing the animation event (not shown). In 
some implementations, a user may select types of animations to be played during an 
idle period and/or select the order in which the animation are played when multiple 
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animations are played during an idle period. A user may configure or otherwise 
determine the duration of time during which no messages are sent that constitutes an 
idle period for the user. 

In some implementations, the processor may detect a wallpaper object trigger 
5 that is different than the trigger used to animate the sender avatar (step 360). For 

example, the processor may detect the passage of a predetermined amount of time. In 
another example, the processor may detect that the content of the instant message 
includes a trigger for a wallpaper object animation that is different from the trigger 
used to animate the sender avatar. Other wallpaper object triggers may include (but 

1 0 are not limited to) the occurrence of a particular day or a particular time of day, the 
existence of any animations by the sender avatar, the existence of a particular type of 
animation by the sender avatar, the existence of animations by the recipient avatar, 
and/or the existence of a particular type of the animation of the recipient avatar. The 
triggers for the animation of wallpaper objects also may be user-configurable such 

15 that a user selects whether a particular type of animation is to be included, any 

animations are to be played, and triggers for one or more of the wallpaper objects. A 
trigger for a type of animation of a wallpaper object or objects may be the same as, or 
different from, one of the triggers associated with animating the avatar. 

When the processor detects a wallpaper object trigger (step 360), the processor 

20 identifies and plays an animation of at least one wallpaper object (step 337). 

The process of identifying and playing types of animations during a sent 
instant message (steps 310-335) is performed for every instant message that is sent 
and for every instant message that is received by the processor. The process of 
identifying and playing types of animation events during periods of inactivity (steps 

25 340-355) may occur multiple times during the instant messaging communications 
session. Steps 3 1 0-355 may be repeated indefinitely until the end of the instant 
messaging communications session. 

The process of identifying and playing the types of animations that correspond 
to a sent instant message or that are played during a period of sender inactivity (steps 

30 320-355) also are performed by the processor of the instant message communications 
application that received the message. In this mamier, the animation of the sender 
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avatar may be viewed by the sender and the recipient of the instant message. Thus, 
the animation of the avatar conveys information from the sender to the recipient that 
is not directly included in the instant message. 

Referring to FIG. 5, an instant messaging interface 500 may be used by a 
sender of a speech-based instant messaging system to send and receive instant 
messages. In the speech-based instant messaging system, instant messages are heard 
rather than read by users. The instant messages may be audio recordings of the users 
of the speech-based instant messaging system, or the instant messages may include 
text that is converted into audible speech with a text-to-speech engine. The audio 
recordings or the audible speech are played by the users. The speech-based instant 
messaging interface 500 may display an avatar 505 corresponding to a user of the 
instant messaging system from which speech-based instant messages are received. 
The avatar 505 may be animated automatically in response to the received instant 
messages such that the avatar 505 appears to be speaking the contents of the instant 
message. The recipient may view the animation of the avatar 505 and gather 
information not directly or explicitly conveyed in the instant message. Depending on 
the animation played, the recipient may be able to determine, for example, the mood 
of the sender or whether the sender is being serious or joking. 

More particularly, the audio message may be processed in the same or similar 
manner as a textual instant message is processed with respect to the animation process 
300 of FIG. 3. In such a case, types of animations are triggered by audio triggers 
included in an instant message. 

In some implementations, the avatar 505 may appear to be speaking the instant 
message. For example, the avatar 505 may include animations of mouth movements 
corresponding to phonemes in human speech to increase the accuracy of the speaking 
animations. When the instant message includes text, a text-to-speech process may 
be generate sounds spoken by the avatar 505, animations corresponding to phonemes 
in the text may be generated, and a lip synchronization process may be used to 
synchronize the playing of the audio with the lip animation such that the phonemes 
are heard at the same time that the corresponding animation of the mouth of the avatar 
505 is seen. When the instant message includes an audio recording, animations 
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corresponding to phonemes in the audio recording may be generated, and a lip 
synchronization used to synchronize the playing of the audio recording with the lip 
animation. 

In another example, a sender may record an audio portion to be associated 
5 with one or more animations of the avatar 505. The recording then may be played 
when the corresponding animation of the avatar 505 is played. 

FIG. 6 illustrates an example process 600 for communicating between instant 
message clients 602a and 602b, through an instant message host system 604, to 
animate one avatar in response to an animation played in a different avatar. Each of 

10 the users using client 602a or client 602b is associated with an avatar that represents 
and projects the user during the instant message session. The communications 
between the clients 602a and 602b are facilitated by an instant messaging host system 
604. In general, the communications process 600 enables a first client 602a and a 
second client 602b to send and receive communications from each other. The 

15 communications are sent through the instant messaging host system 604. Some or all 
of the communications may trigger an animation or animations in an avatar associated 
with the user of the first client 602a and an animation or animations in an avatar 
associated with the user of the second client 602b. 

An instant messaging communications session is established between the first 

20 client 602a and the second client 602b in which communications are sent through the 
instant messaging server host system 604 (step 606). The communications session 
involves a first avatar that represents the user of the first client 602a and a second 
avatar that represents the user of the second client 602b. This may be accomplished, 
for example, as described previously with respect to step 305 of FIG. 3. hi general, 

25 both the user of the first client 602a and the user of the second client 602b may use a 
user interface similar to the user interface 1 00 of FIG. 1 in which the sender avatar 
and the recipient avatar are displayed on the first client 602a and on the second client 
602b. 

During the instant messaging communications session, a user associated with 
30 the first client 602a enters text of an instant message to be sent to a user of the second 
client 602b, which is received by the processor on the client 602aexecuting the instant 
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messaging communications application (step 608). The entered text may include a 
trigger for one of the animations from the first avatar model. The processor executing 
the instant messaging communications application sends the entered text to the second 
client 602b in the instant message by way of the host system 604 (step 610). 
5 Specifically, the host system 604 receives the message and forwards the message 
from the first client 602a to the second client 602b (step 612). The message then is 
received by the second client 602b (step 614). Upon receipt of the message, the 
second client 602b displays the message in a user interface in which messages from 
the user of the first client 602a are displayed. The user interface may be similar to the 

10 instant messaging user interface 105 from FIG. 1, in which avatars corresponding to 
the sender and the recipient are displayed. 

Both the first client 602a and the second client 602b have a copy of the 
message, and both the first client 602a and the second client 602b begin processing 
the text of the message to determine if the text of the message triggers any animations 

15 in the respective copies of the first and second avatar models. When processing the 
message, the first client 602a and the second client 602b may actually process the 
message substantially concurrently or serially, but both the first client 602a and the 
second client 602b process the message in the same way. 

Specifically, the first client 602a searches the text of the message for 

20 animation triggers to identify a type of animation to play (step 616a). The first client 
602a then identifies an animation having the identified type of animation for a first 
avatar associated with the user of the first client 602a (step 618a). The first client 
602a plays the identified animation for the first avatar that is associated with the user 
of the first client 602a (step 620a). The first avatar model is used to identify the 

25 animation to be played because the first avatar model is associated with the first client 
602a, which sent the message. The first client 602a and the second client 602b use 
identical copies of the first avatar model to process the message, so the same 
animation event is seen on the first client 602a and the second client 602b. 

The animation from the first avatar model triggers an animation from the 

30 second avatar model. To do so, the first client 602a identifies, based on the identified 
type of animation played for the first avatar in response to the text trigger, a type of 
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animation to be played for a second avatar that is associated with the user of the 
second client 602b (step 622a). The first client 602b plays the identified type of 
animation for the second avatar (step 624a). 

The first client also may identify a type of animation to be played for 
5 wallpaper corresponding to the first avatar and plays the identified wallpaper 

animation of the first avatar (step 626a). The wallpaper of the avatar may include an 
object or objects that are animated during the instant message communications 
session. The animation of the object or objects may occur based on, for example, a 
trigger in an instant message or the passage of a predetermined amount of time. The 

10 animation of wallpaper objects also may be user-configurable such that a user selects 
whether a particular type animation, or any animations, are played, and the triggers 
for one or more of the wallpaper objects. A trigger for a type of animation of a 
wallpaper object or objects may be the same as, or different from, one of the triggers 
associated with animating the avatar. After the message has been sent and processed, 

15 the user of the first client 602a may not send any additional messages for a period of 
time. The first client 602a detects such a period of inactivity (step 628a). The first 
client 602a identifies and plays an animation of a type associated with a period of 
inactivity of detected by the first client 602a (step 630a). This may be accomplished 
by using a database table, list or file that identifies one or more types of animations to 

20 play during a detected idle period. 

The second client 602b processes the instant message in the same was as the 
first client 602a. Specifically, the second client 602b processes the message with 
steps 616b through 630b, each of which are substantially the same as parallel the 
message processing steps 616a through 630a performed by the first client 602a. 

25 Because each of the first client 602a and the second client 602b have copies of the 
avatars corresponding to the users of the first client 602a and the second client 602b, 
the same animations that were played on the first client 602a as a result of executing 
steps 616a through 630a are played on the second client 602b as a result of executing 
the similar steps 616b through 630b. 

30 During the communications process 600, a text-based message indicates the 

types of animations that occur. However, messages with different types of content 
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also may trigger animations of the avatars. For example, characteristics of an audio 
signal included in an audio-based message may trigger animations from the avatars. 

Referring to FIG. 7, a process 700 is used to select and optionally customize 
an avatar for use with an instant messaging system. An avatar may be customized to 
5 reflect a personality to be expressed or another aspect of self-expression of the user 
associated with the avatar. The process 700 begins when a user selects an avatar from 
multiple avatars and the selection is received by the processor executing the process 
700 (step 705). For example, a user may select a particular avatar from multiple 
avatars such as the avatars illustrated in FIG. 8. Each of the avatars 805a-805r is 

10 associated with an avatar model that specifies the appearance of the avatar. Each of 
the avatars 805a-805r also includes multiple associated animations, each animation 
identified as being of a particular animation type. The selection may be 
accomplished, for example, when a user selects one avatar from a group of displayed 
avatars. The display of the avatars may show multiple avatars in a window, such as 

15 by showing a small representation (which in some implementations may be referred to 
as a "thumbnail") of each avatar. Additionally or alternatively, the display may be a 
list of avatar names from which the user selects. 

FIG. 8 illustrates multiple avatars 805a-805r. Each avatar 805a-805r includes 
an appearance, name, and personality description. In one example, avatar 805a has an 

20 appearance 810a, a name 810b and a personality description 810c. The appearance of 
an avatar may represent, by way of example, living, fictional or historical people, sea 
creatures, amphibians, reptiles, mammals, birds, or animated objects. Some avatars 
may be represented only with a head, such as avatars 805a-805r. In one example, the 
appearance of the avatar 805b includes a head of a sheep. The appearance of other 

25 avatars may include only a portion or a specific part of a head. For example, the 
appearance of the avatar 8051 resembles a set of lips. Other avatars may be 
represented by a body in addition to a head. For example, the appearance of the 
avatar 805n includes a full crab body in addition to a head. An avatar may be 
displayed over wallpaper that is related in subject matter to the avatar. In one 

30 example, the avatar 805i is displayed over wallpaper that is indicative of a swamp in 
which the avatar 805j lives. 
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Each of the avatars 805a-805r has a base state expression. For example, the 
avatar 805f appears to be happy, the avatar 805j appears to be sad, and the avatar 
805m appears to be angry. Avatars may have other base state expressions, such as 
scared or bored. The base state expression of an avatar may influence the behavior of 
5 the avatar, including the animations and the sounds of the avatar. In one example, the 
avatar 805f has a happy base state expression and consequently has a generally happy 
behavior, whereas the avatar 805m has a creepy base state expression and 
consequently has a generally scary, creepy and spooky demeanor. In another 
example, a happy avatar may have upbeat sounds while an angry avatar may appear to 

10 be shouting when a sound is produced. The base state expression of an avatar may be 
changed as a result of the activities of a user associated with the avatar. By way of 
example, the degree of happiness expressed by the avatar may be related to the 
number of messages sent or received by the user. When the user sends or receives 
many messages in a predetermined period of time, the avatar may appear happier than 

15 when the user sends or receives fewer messages in the predetermined period of time. 

One of multiple avatars 805a-805r may be chosen by a user of the instant 
messaging system. Each of the avatars 805a-805r is associated with an appearance, 
characteristics and behaviors that express a particular type of personality. For 
example, an avatar 805f, which has appearance characteristics of a dolphin, may be 

20 chosen. 

Each of the avatars 805a-805r is a multi-dimensional character with depth of 
personality, voice, and visual attributes. In contrast to representing a single aspect of 
a user through the use of an unanimated, two-dimensional graphical icon, an avatar of 
the avatars 805a-805r is capable of indicating a rich variety of information about the 

25 user projecting the avatar. Properties of the avatar enable the communication of 

physical attributes, emotional attributes, and other types of context information about 
the user that are not well-suited (or even available) for presentation through the use of 
two-dimensional icons that are not animated. In one example, the avatar may reflect 
the user's mood, emotions, and personality. In another example, the avatar may 

30 reflect the location, activities and other context of the user. These characteristics of 
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the user may be communicated through the appearance, the visual animations, and the 
audible sounds of the avatar. 

In one example of an avatar personality, an avatar named SoccerBuddy (not 
shown) is associated with an energetic personality. In fact, the personality of the 
5 SoccerBuddy avatar may be described as energetic, bouncy, confidently enthusiastic, 
and youthful. The SoccerBuddy avatar's behaviors reflect events in soccer matches. 
For example, the avatar's yell animation is an "ole, ole, ole" chant, his big-smile 
animation is "gooooooaaaaaallllll," and, during a frown animation or a tongue-out 
animation, the avatar shows a yellow card. Using wallpaper, the SoccerBuddy is 

10 customizable to represent a specific team. Special features of the SoccerBuddy avatar 
include cleated feet to represent the avatar's base. In general, the feet act as the base 
for the avatar. The SoccerBuddy avatar is capable of appearing to move about by 
pogo-sticking on his feet. In a few animations, such as when the avatar goes away, 
the avatar's feet may become large and detach from the SoccerBuddy. The feet are 

15 able to be animated to kick a soccer ball around the display. 

In another example, a silent movie avatar is reminiscent of silent film actor in 
the 1920's and 1930's. A silent movie avatar is depicted using a stove-pipe hat and a 
handle-bar moustache. The silent movie avatar is not associated with audio. Instead 
of speakings the silent movie avatar is replaced by 9 or displays, placards having text in 

20 a manner similar to how speech was conveyed in a silent movie. 

In other examples, an avatar may be appropriate to current events or a season. 
In one example, an avatar may represent a team or a player on a team involved in 
professional or amateur sport. An avatar may represent a football team, a baseball 
team, or a basketball team, or a particular player of a team. In one example, teams 

25 engaged in a particular playoff series may be represented. Examples of seasonal 
avatars include a Santa Claus avatar, an Uncle Sam avatar, a Thanksgiving turkey 
avatar, a Jack-o-Lantern avatar, a Valentine's Day heart avatar, an Easter egg avatar, 
and an Easter bunny avatar. 

Animation triggers of the avatar may be modified to customize when various 

30 types of animations associated with the avatar are to occur (step 710). For example, a 
user may modify the triggers shown in FIG. 4 to indicate when an avatar is to be 
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animated, as described previously with respect to FIG. 3 . The triggers may be 
augmented to include frequently used words, phrases, or character strings. The 
triggers also may be modified such that the animations that are played as a result of 
the triggers are indicative of the personality of the avatar. Modifying the triggers may 
5 help to define the personality expressed by the avatar and used for user self- 
expression. 

A user also may configure the appearance of an avatar (step 715). This also 
may help define the personality of the avatar, and communicate a self-expressive 
aspect of the sender. For example, referring also to FIG. 9, an appearance 

10 modification user interface 900 may be used to configure the appearance of an avatar. 
In the example of FIG. 9, the appearance modification user interface 900 enables the 
user to modify multiple characteristics of a head of an avatar. For example, hair, 
eyes, nose, lips and skin tone of the avatar may be configured with the appearance 
modification user interface 900. For example, a hair slider 905 may be used to 

15 modify the length of the avatar's hair. The various positions of the hair slider 905 
represent different possible lengths of hair for the avatar that correspond to different 
representations of the hair of the avatar included in the avatar model file associated 
with the avatar being configured. An eyes slider 910 may be used to modify the color 
of the avatar's eyes, with each position of the eyes slider 910 representing a different 

20 possible color of the avatar's eyes and each color being represented in the avatar 

model file. A nose slider 915 may be used to modify the appearance of the avatar's 
nose, with each position of the nose slider 915 representing a different possible 
appearance of the avatar's nose and each possible appearance being represented in the 
avatar model file. In a similar manner, a lips slider 920 may be used to modify the 

25 appearance of the avatar's lips, with each position of the lips slider 920 representing a 
different possible appearance of the avatar's lips and associated with a different lip 
representation in the avatar model file. The avatar's skin tone also may be modified 
with a skin tone slider 925. Each of the possible positions of the skin tone slider 925 
represents a possible skin tone for the avatar with each being represented in the avatar 

30 model file. 
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The appearance of the avatar that is created as a result of using the sliders 905- 
925 may be previewed in an avatar viewer 930. The values chosen with the sliders 
905-925 are reflected in the avatar illustrated in the avatar viewer 930. In one 
implementation, the avatar viewer 930 may be updated as each of the sliders 905-925 
5 is moved such that the changes made to the avatar's appearance are immediately 

visible. In another implementation, the avatar viewer 930 may be updated once after 
all of the sliders 905-925 have been used. 

A rotation slider 93 5 enables the rotation of the avatar illustrated in the avatar 
viewer 930. For example, the avatar may be rotated about an axis by a number of 

10 degrees chosen on the rotation slider 935 relative to an unrotated orientation of the 
avatar. In one implementation, the axis extends vertically through the center of the 
avatar's head and the unrotated orientation of the avatar is when the avatar is facing 
directly forward. Rotating the avatar's head with the rotation slider 930 enables 
viewing of all sides of the avatar to illustrate the changes to the avatar's appearance 

15 made with the sliders 905-925. The avatar viewer 930 may be updated as the rotation 
slider 930 is moved such that changes in the orientation of the avatar may be 
immediately visible. 

The appearance modification user interface 900 also includes a hair tool 
button 940 9 a skin tool button 945, and a props tool button 950, Selecting the hair tool 

20 button 940 displays a tool for modifying various characteristics of the avatar's hair. 
For example, the tool displayed as a result of selecting the hair tool button 940 may 
enable changes to, for example, the length, color, cut, and comb of the avatar's hair. 
In one implementation, the changes made to the avatar's hair with the tool displayed 
as a result of selecting the hair tool button 940 are reflected in the illustration of the 

25 avatar in the avatar viewer 930. 

Similarly, selecting a skin tool button 945 displays a tool for modifying 
various aspects of the avatar's skin. For example, the tool displayed as a result of 
selecting the skin tool button 945 may enable, for example, changing the color of the 
avatar's skin, giving the avatar a tan, giving the avatar tattoos, or changing the 

30 weathering of the avatar's skin to give appearances of the age represented by the 
avatar. In one implementation, the changes made to the avatar's skin with the tool 
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displayed as a result of selecting the skin tool button 945 are reflected in the 
illustration of the avatar in the avatar viewer 930. 

In a similar manner, selecting the props tool button 950 displays a tool for 
associating one or more props with the avatar. For example, the avatar may be given 
5 eyeglasses, earrings, hats, or other objects that may be worn by, or displayed on or 
near, the avatar through use of the props tool. In one implementation, the props given 
to the avatar with the tool displayed as a result of selecting the props tool button 950 
are shown in the illustration of the avatar in the avatar viewer 930. In some 
implementations, all of the props that may be associated with the avatar are included 

10 in the avatar model file. The props controls whether each of the props is made visible 
when the avatar is displayed, hi some implementations, a prop may be created using 
and rendered by two-dimensional animation techniques. The rendering of the prop is 
synchronized with animations for the three-dimensional avatar. Props may be 
generated and associated with an avatar after the avatar is initially created. 

15 Once all desired changes have been made to the avatar's appearance, the user 

may accept the changes by selecting a publish button 955. Selecting the publish 
button 955 saves the changes made to the avatar's appearance, hi addition, when 
copies of the avatar are held by other users of the instant messaging system to reflect 
the change made, the other users are sent updated copies of the avatar that reflect the 

20 changes made by the user to the avatar. The copies of the avatar may be updated so 
that all copies of the avatar have the same appearance such that there is consistency 
among the avatars used to send and receive out-of-band communications. The 
appearance modification user interface 900 may be used by the user to change only 
copies of the avatar corresponding to the user. Therefore, the user is prevented from 

25 making changes to other avatars corresponding to other users that may be overwritten 
he user is sent updated copies of the other avatars because the other users made 
changes to the other avatars. Preventing the user from modifying the other avatars 
ensures that all copies of the avatars are identical. 

The avatar illustrated in the avatar viewer 930 may have an appearance that 

30 does not include one of hair, eyes, a nose, lips, or skin tone that are modified with the 
sliders 905-925. For example, the appearance of the avatar 8051 from FIG. 8 does not 
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include hair, eyes, a nose, or skin tone. In such a case, the appearance modification 
user interface 900 may omit the sliders 905-925 and instead include sliders to control 
other aspects of the appearance of the avatar. For example, the appearance 
modification user interface 900 may include a teeth slider when the appearance of the 
avatar 8051 is being modified. Moreover, the interface 900 may be customized based 
on the avatar selected, to enable appropriate and relevant visual enhancements thereto. 

In another example of configuring the appearance of an avatar, a configurable 
facial feature of an avatar may be created using blend shapes of the animation model 
corresponding to the avatar. A blend shape defines a portion of the avatar that may be 
animated. In some implementations, a blend shape may include a mesh percentage 
that may be modified to cause a corresponding modification in the facial feature. In 
such a case, a user may be able to configure a facial feature of an avatar by using a 
slider or other type of control to modify the mesh percentage of the blend shapes 
associated with the facial feature being configured. 

hi addition to modifying the appearance of the avatar with the appearance 
modification user interface 900, the color, texture, and particles of the avatar may be 
modified. More particularly, the color or shading of the avatar may be changed. The 
texture applied to avatar may be changed to age or weather the skin of the avatar. 
Furthermore, the width, length, texture, and color of particles of the avatar may be 
customized. In one example, particles of the avatar used to portray hair or facial hair, 
such as a beard, may be modified to show hair or beard growth in the avatar. 

Referring again to FIG. 7, wallpaper over which the avatar is illustrated and an 
animation for objects in the wallpaper may be chosen (step 720). This may be 
accomplished by, for example, choosing wallpaper from a set of possible wallpapers. 
The wallpapers may include animated objects, or the user may choose objects and 
animations for the chosen objects to be added to the chosen wallpaper. 

A trading card that includes an image of the avatar, a description of the avatar 
may be created (step 725). In some implementations, the trading card also may 
include a description of the user associated with the avatar. The trading card may be 
shared with other users of the instant messaging system to inform the other users of 
the avatar associated with the user. 
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Referring also to FIG. 10, one example of a trading card is depicted. The front 
side 1045 of the trading card shows the avatar 1046. The animations of the avatar 
may be played by selecting the animations control 1047. The back side 1050 of the 
trading card includes descriptive information 1051 about the avatar, including the 
avatar's name, date of birth, city, species, likes, dislikes, hobbies, and aspirations. As 
illustrated in FIG. 10, both the front side 1045 and the back side 1050 of the trading 
card is shown, hi some implementations, only one side 1045 or 1050 of the trading 
card is able to be displayed at one time. In such a case, a user may be able to control 
the side of the trading card that is displayed by using one of the flip controls 1048 or 
1052. A store from which accessories for the avatar 1046 illustrated in the trading 
card may be accessed by selecting a shopping control 1049. 

Referring again to FIG. 7, the avatar also may be exported for use in another 
application (step 730). In some implementations, an avatar may be used by an 
application other than a messaging application. In one example, an avatar may be 
displayed as part of a user's customized home page of the user's access provider, such 
as an Internet service provider. An instant message sender may drag-and-drop an 
avatar to the user's customized home page such that the avatar is viewable by the user 
corresponding to the avatar. In another example, the avatar may be used in an 
application in which the avatar is viewable by anyone. An instant message sender 
may drag-and-drop the sender's avatar to the sender's blog or another type of 
publicly-accessible online journal. The user may repeat one or more of the steps in 
process 700 until the user is satisfied with the appearance and behavior of the avatar. 
The avatar is saved and made available for use in an instant messaging 
communications session. 

Referring again to FIG. 10, the avatar settings user interface 1000 includes a 
personality section 1002. Selecting a personality tab 1010 displays a personality 
section of the avatar settings interface 1000 for modifying the behavior of the one or 
more avatars. In one implementation, the avatar settings user interface 1000 may be 
used with the process 700 of FIG. 7 to choose the wallpaper of an avatar and/or to 
create a trading card for an avatar. 
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The personality section 1002 of the avatar settings interface 1000 includes an 
avatar list 1015 including the one or more various avatars corresponding to the user of 
the instant messaging system. Each of the one or more avatars may be specified to 
have a distinct personality for use while communicating with a specific person or in a 
5 specific situation. In one implementation, an avatar may change appearance or 
behavior depending on the person with which the user interacts. For example, an 
avatar may be created with a personality that is appropriate for business 
communications, and another avatar may be created with a personality that is 
appropriate for communications with family members. Each of the avatars may be 

10 presented in the list with a name as well as a small illustration of each avatar's 

appearance. Selection of an avatar from the avatar list 1015 enables the specification 
of the behavior of the selected avatar. For example, the avatar 1020, which is chosen 
to be the user's default avatar, has been selected from the avatar list 1015, so the 
behavior of the avatar 1020 may be specified. 

15 Names of the avatars included in the avatar list may be changed through 

selection of a rename button 1025. Selecting the rename button displays a tool for 
changing the name of an avatar selected from the avatar list 1015. Similarly, an 
avatar may be designated as a default avatar by selecting a default button 1030 after 
selecting the avatar from the avatar list 1015. Avatars may be deleted by selecting a 

20 delete button 1035 after selecting the avatar from the avatar list 1015. In one 

implementation, a notification is displayed before the avatar is deleted from the avatar 
list 1015. Avatars also may be created by selecting a create button 1040. When the 
create button 1040 is pressed, a new entry is added to the avatar list 1015. The entry 
may be selected and modified in the same way as other avatars in the avatar list 1015. 

25 The behavior of the avatar is summarized in a card front 1045 and a card back 

1050 displayed on the personality section. The card front 1045 includes an 
illustration of the avatar and wallpaper over which the avatar 1020 is illustrated. The 
card front 1045 also includes a shopping control 1049 to a means for purchasing props 
for the selected avatar 1020. The card back 1050 includes information describing the 

30 selected avatar 1020 and a user of the selected avatar. The description may include a 
name, a birth date, a location, as well as other identifying and descriptive information 
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for the avatar and the user of the avatar. The card back 1050 also may include an 
illustration of the selected avatar 1020 as well as the wallpaper over which the avatar 
1020 is illustrated. The trading card created as part of the avatar customization 
process 700 includes the card front 1045 and the card back 1050 automatically 
generated by the avatar settings interface 1000. 

The personality section 1002 of the avatar settings interface 1000 may include 
multiple links 1055-1070 to tools for modifying other aspects of the selected avatar's 
1020 behavior. For example, an avatar link 1055 may lead to a tool for modifying the 
appearance of the selected avatar 1020. hi one implementation, selecting the avatar 
link 1055 may display the appearance modification user interface 900 from FIG. 9. In 
another implementation, the avatar link 1055 may display a tool for substituting or 
otherwise selecting the selected avatar 1020. In yet another example, the avatar link 
1055 may allow the appearance of the avatar to be changed to a different species. For 
example, the tool may allow the appearance of the avatar 1020 to be changed from 
that of a dog to that of a cat. 

A wallpaper link 1060 may be selected to display a tool for choosing the 
wallpaper over which the selected avatar 1020 is drawn, hi one implementation, the 
wallpaper may be animated. 

A sound link 1 065 may be selected to display a tool with which the sounds 
made by the avatar 1020 may be modified. The sounds may be played when the 
avatar is animated, or at other times, to get the attention of the user. 

An emoticon link 1070 may be selected to display a tool for specifying 
emoticons that are available when communicating with the selected avatar 1020. 
Emoticons are two-dimensional non-animated images that are sent when certain 
triggers are included in the text of an instant message. Changes made using the tools 
that are accessible through the links 1055-1070 may be reflected in the card front 
1045 and the card back 1050. After all desired changes have been made to the avatars 
included in the avatar list 1015, the avatar settings interface 1000 may be dismissed 
by selecting a close button 1075. 

It is possible, through the systems and techniques described herein, 
particularly with respect to FIGS. 1 1 A- 14, to enable users to assemble multiple self- 
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expression items into a collective "online persona" or "online personality," which 
may then be saved and optionally associated with one or more customized names. 
Each self-expression item is used to represent the instant message sender or a 
characteristic or preference of the instant message sender, and may include user- 
selectable binary objects. The self-expression items may be made perceivable by a 
potential instant message recipient ("instant message recipient") before, during, or 
after the initiation of communications by a potential instant message sender ("instant 
message sender"). For example, self-expression items may include an avatar, images, 
such as wallpaper, that are applied in a location having a contextual placement on a 
user interface. The contextual placement typically indicates an association with the 
user represented by the self-expression item. For instance, the wallpaper may be 
applied in an area where messages from the instant message sender are displayed, or 
in an area around a dialog area on a user interface. Self-expression items also include 
sounds, animation, video clips, and emoticons (e.g., smileys). The personality may 
also include a set of features or functionality associated with the personality. For 
example, features such as encrypted transmission, instant message conversation 
logging, and forwarding of instant messages to an alternative communication system 
may be enabled for a given personality. 

Users may assign personalities to be projected when conversing with other 
users, either in advance of or "on-the-fly" during a communication session. This 
allows the user to project different personalities to different people on-line. In 
particular, users may save one or more personalities (e.g., where each personality 
typically includes groups of instant messaging self-expression items such as, for 
example avatars, Buddy Sounds, Buddy Wallpaper, and Smileys, and/or a set of 
features and functionalities) and they may name those personalities to enable their 
invocation, they may associate each of different personalities with different users with 
whom they communicate or groups of such users so as to automatically display an 
appropriate/selected personality during communications with such other users or 
groups, or they may establish each of different personalities during this process of 
creating, adding or customizing lists or groups of users or the individual users 
themselves. Thus, the personalities may be projected to others in interactive online 
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environments (e.g., Instant Messaging and Chat) according the assignments made by 
the user. Moreover, personalities may be assigned, established and/or associated with 
other settings, such that a particular personality may be projected based on time-of- 
day, geographic or virtual location, or even characteristics or attributes of each (e.g., 
5 cold personality for winter in Colorado or chatting personality while participating in a 
chat room). 

In many instances, an instant message sender may have multiple online 
personas for use in an instant message communications session. Each online persona 
is associated with an avatar representing the particular online persona of the instant 

10 message sender. In many cases, each online persona of a particular instant message 
sender is associated with a different avatar. This need not be necessarily so. 
Moreover, even when two or more online personas of a particular instant message 
sender include the same avatar, the appearance or behavior of the avatar may be 
different for each of the online personas. In one example, a starfish avatar may be 

15 associated with two online personas of a particular instant message sender. The 
starfish avatar that is associated with one online persona may have different 
animations than the other starfish avatar that is associated with the other online 
persona. Even when both of the starfish avatars include the same animations, one of 
the starfish avatars may be animated to display an animation of a particular type based 

20 on different triggers than the same animation that is displayed for the other of the 
starfish avatars. 

FIG. 1 1 A shows relationships between online personas, avatars, avatar 
behaviors and avatar appearances. In particular, FIG. 1 1 A shows online personas 
1 102a-l 102e and avatars 1 104a-l 104d that are associated with the online personas 

25 11 02a- 1 1 02e. Each of the avatars 1 1 04a- 1 1 04d includes an appearance 1 1 06a- 1 1 06c 
and a behavior 1 108a-l 108d. More particularly, the avatar 1 104a includes an 
appearance 1 106a and a behavior 1 108a; the avatar 1 104b includes an appearance 
1 106b and a behavior 1 108b; the avatar 1 104c includes the appearance 1 106c and a 
behavior 1 108c; and the avatar 1 104d includes an appearance 1 106c and a behavior 

30 11 08d. The avatars 1 1 04c and 1 1 04d are similar in that both include the appearance 
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1 106c. However, the avatars 1 104c and 1 104d differ in that the avatar 1 104c includes 
the behavior 1 108c while the avatar 1 104d includes the behavior 1 108d. 

Each of the online personas 1 102a-l 102e is associated with one of the avatars 
1 104a~l 104d. More particularly, the online persona 1 102a is associated with the 
5 avatar 1 104a; the online persona 1 102b is associated with the avatar 1 104b; the online 
persona 1 102c also is associated with the avatar 1 104b the online persona 1 102d is 
associated with the avatar 1 104c; and the online persona 1 102e is associated with the 
avatar 1 104d. As illustrated by the online persona 1 102a that is associated with the 
avatar 1 104a, an online persona may be associated with an avatar that is not also 

10 associated with a different online persona. 

Multiple online personas may use the same avatar. This is illustrated by the 
online personas 1 102b and 1 102c that are both associated with the avatar 1 104b. In 
this case, the appearance and behavior exhibited by avatar 1 104b is the same for both 
of the online personas 1 102b and 1 102c. hi some cases, multiple online personas may 

15 use similar avatars that have the same appearance by which exhibit different behavior, 
as illustrated by online personas 1 102d and 1 102e. The online personas 1 1 02d and 
1 102e are associated with similar avatars 1 104c and 1 104d that have the same 
appearance 1106c. The avatars 1102d and 1102e, however, exhibit different behavior 
1108c and 1108d, respectively. 

20 In creating personalities, the instant message sender may forbid a certain 

personality to be shown to designate instant message recipients and/or groups. For 
example, if the instant message sender wants to ensure that the "Casual" personality is 
not accidentally displayed to the boss or to co-workers, the instant message sender 
may prohibit the display of the "Casual" personality to the boss on an individual 

25 basis, and may prohibit the display of the "Casual" personality to the "Co-workers" 
group on a group basis. An appropriate user interface may be provided to assist the 
instant message sender in making such a selection. Similarly, the instant message 
sender may be provided an option to "lock" a personality to an instant message 
recipient or a group of instant message recipients to guard against accidental or 

30 unintended personality switching and/or augmenting. Thus, for example, the instant 
message sender may choose to lock the "Work" personality to the boss on an 
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individual basis, or to lock the "Work" personality to the "Co-workers" group on a 
group basis. In one example, the Casual personality will not be applied to a locked 
personality. 

FIG. 1 IB shows an exemplary process 1 100 to enable an instant message 
sender to select an online persona to be made perceivable to an instant message 
recipient. The selected online persona includes an avatar representing the online 
persona of the instant message sender. The process 1 100 generally involves selecting 
and projecting an online persona that includes an avatar representing the sender. The 
instant message sender creates or modifies one or more online personalities, including 
an avatar representing the sender (step 1 105). The online personalities may be created 
or modified with, for example, the avatar settings user interface 1000 of FIG. 10. 
Creating an online persona generally involves the instant message sender selecting 
one or more self-expression items and/or features and functionalities to be displayed 
to a certain instant message recipient or group of instant message recipients. A user 
interface may be provided to assist the instant message sender in making such a 
selection, as illustrated in FIG. 12. 

FIG. 12 shows a chooser user interface 1200 that enables the instant message 
sender to select among available personalities 1205, 1210, 1215, 1220, 1225, 1230, 
1235, 1240, 1245, 1250, and 1255. The user interface 1200 also has a control 1260 to 
enable the instant message sender to "snag" the personality of another user, and a 
control 1265 to review the personality settings currently selected by the instant 
message sender. Through the use of the avatar settings interface 1000, the user may 
change the personality, including the avatar, being projected to the instant message 
recipient before, during, or after the instant message conversation with the recipient. 

Alternatively, the selection of a personality also may occur automatically 
without sender intervention. For example, an automatic determination may be made 
that the sender is sending instant messages from work. In such a case, a personality to 
be used at work may be selected automatically and used for all communications. As 
another example, an automatic determination may be made that the sender is sending 
instant messages from home, and a personality to be used at home may be selected 
automatically and used for all communications. In such an implementation, the 
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sender is not able to control which personality is selected for use. In other 
implementations, automatic selection of a personality may be used in conjunction 
with sender selection of a personality, in which case the personality automatically 
selected may act as a default that may be changed by the sender. 
5 FIG. 13 shows a series 1300 of exemplary user interfaces for enabling an 

instant message sender to create and store a personality, and/or select various aspects 
of the personality such as avatars, buddy wallpaper, buddy sounds, and smileys. As 
shown, user interface 1305 enables an instant message sender to select a set of one or 
more self-expression items and save the set of self-expression items as a personality. 

10 The user interface 1305 also enables an instant message sender to review and make 
changes to an instant message personality. For example, the user interface 1305 
enables an instant message sender to choose an avatar 1310 (here, referred to as a 
SuperBuddy), buddy wallpaper 1315, emoticons 1320 (here, referced to as Smileys), 
and buddy sounds 1325. A set of controls 1340 is provided to enable the instant 

15 message sender to preview 1340a the profile and to save 1340b these selected self- 
expression items as a personality. The instant message sender is able to name and 
save the personality 1345 and then is able to apply the personality 1350 to one or 
more individual instant message recipients or one or more groups of instant message 
recipients. A management area 1350a is provided to enable the instant message 

20 sender to delete, save, or rename various instant message personalities, hi choosing 
the self-expression items, other interfaces such as user interface 1355 may be 
displayed to enable the instant message sender to select the particular self-expression 
items. The user interface 1355 includes a set of themes 1360 for avatars which 
enables an instant message sender to select a particular theme 1365 and choose a 

25 particular avatar 1370 in the selected theme. A set of controls 1375 is provided to 
assist the instant message sender in making the selection of self-expression items. 
Also, an instant message sender may be enabled to choose a pre-determined theme, 
for example, by using a user interface 1380. In user interface 1380, the instant 
message sender may select various categories 1385 of pre-selected themes and upon 

30 selecting a particular category 1390, a set of default pre-selected, self-expression 
items is displayed, 1390a, 1390b, 1390c, 1390d, 1390e, and 1390f. The set may be 
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unchangeable or the instant message sender may be able to individually change any of 
the pre-selected self-expression items in the set. A control section 1395 is also 
provided to enable the instant message sender to select the themes. 

In another implementation, the features or functionality of the instant message 
interface may vary based upon user-selected or pre-selected options for the 
personality selected or currently in use. The features or functionality may be 
transparent to the instant message sender. For example, when using the "Work" 
personality, the outgoing instant messages may be encrypted, and a copy may be 
recorded in a log, or a copy may be forwarded to a designated contact such as an 
administrative assistant. A warning may be provided to an instant message recipient 
that the instant message conversation is being recorded or viewed by others, as 
appropriate to the situation. By comparison, if the non-professional "Casual" 
personality is selected, the outgoing instant messages may not be encrypted and no 
copy is recorded or forwarded. 

As a further example, if the "Work" personality is selected and the instant 
message sender indicates an unavailability to receive instant messages (e.g., through 
selection of an "away" message or by going offline), then messages received from 
others during periods of unavailability may be forwarded to another instant message 
recipient such as an administrative assistant, or may be forwarded to an e-mail address 
for the instant message sender. By comparison, if the non-professional "Casual" 
personality is selected, no extra measures are taken to ensure delivery of the message. 

In one implementation, the features and functionality associated with the 
personality would be transparent to the instant message sender, and may be based 
upon one or more pre-selected profiles types when setting up the personality. For 
example, the instant message sender may be asked to choose from a group of 
personality types such as professional, management, informal, vacation, offbeat, etc. 
In the example above, the "Work" personality may have been be set up as a 
"professional" personality type and the "Casual" personality may have been set up as 
an "informal" personality type. In another implementation, the instant message 
sender may individually select the features and functionalities associated with the 
personality. 
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Referring again to FIG. 1 IB, the personality is then stored (step 1110). The 
personality may be stored on the instant message sender system, on the instant 
message host system, or on a different host system such as a host system of an 
authorized partner or access provider. 

Next, the instant message sender assigns a personality to be projected during 
future instant message sessions or when engaged in future instant message 
conversations with an instant message recipient (step 1115). The instant message 
sender may wish to display different personalities to different instant message 
recipients and/or groups in the buddy list. The instant message sender may use a user 
interface to assign personalization items to personalities on at least a per-buddy group 
basis. For example, an instant message sender may assign a global avatar to all 
personalities, but assign different buddy sounds on a per- group basis to other 
personalities (e.g. work, family, friends), and assign buddy wallpaper and smileys on 
an individual basis to individual personalities corresponding to particular instant 
message recipients within a group. The instant message sender may assign other 
personality attributes based upon the occurrence of certain predetermined events or 
triggers. For example, certain potential instant message recipients may be designated 
to see certain aspects of the Rainy Day personality if the weather indicates rain at the 
geographic location of the instant message sender. Default priority rules may be 
implemented to resolve conflicts, or the user may select priority rules to resolve 
conflicts among personalities being projected or among self-expression items being 
projected for an amalgamated personality. 

For example, a set of default priority rules may resolve conflicts among 
assigned personalities by assigning the highest priority to personalities and self- 
expression items of personalities assigned on an individual basis, assigning the next 
highest priority to assignments of personalities and personalization items made on a 
group basis, and assigning the lowest priority to assignments of personalities and 
personalization items made on a global basis. However, the user may be given the 
option to override these default priority rules and assign different priority rules for 
resolving conflicts. 
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Next, an instant message session between the instant message sender and the 
instant message recipient is initiated (step 1 120). The instant message session may be 
initiated by either the instant message sender or the instant message recipient. 

An instant message user interface is rendered to the instant message recipient, 
5 configured to project the personality, including the avatar, assigned to the instant 
message recipient by the instant message sender (step 1 125), as illustrated, for 
example, in the user interface 1 00 in FIG. 1 . The personality, including an avatar 
associated with the personality, chosen by an instant messaging recipient may be 
made perceivable upon opening of a communication window by the instant message 
10 sender for a particular instant message recipient but prior to initiation of 
communications. This may allow a user to determine whether to initiate 
communications with instant message recipient. For example, an instant message 
sender may notice that the instant message recipient is projecting an at-work 
personality, and the instant message sender may decide to refrain from sending an 
1 5 instant message. This may be particularly true when the avatar of the instant message 
recipient is displayed on a contact list. On the other hand, rendering the instant 
message recipient avatar after sending an instant message may result in more efficient 
communications . 

The appropriate personality/personalization item set for a buddy is sent to the 
20 buddy when the buddy communicates with the instant message sender through the 

instant messaging client program. For example, in an implementation which supports 
global personalization items, group personalization items, and personal 
personalization items, a personal personalization item is sent to the buddy if set, 
otherwise a group personalization item is sent, if set. If neither a personal nor a group 
25 personalization item is set, then the global personalization item is sent. As another 
example, in an implementation that supports global personalization items and group 
personalization items, the group personalization item for the group to which the 
buddy belongs is sent, if set, otherwise the global personalization item is sent. In an 
implementation that only supports group personalization items, the group 
30 personalization item for the group to which the buddy belongs is sent to the buddy. 
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An instant message session between the instant message sender and another 
instant message recipient also may be initiated (step 1130) by either the instant 
message sender or the second instant message recipient. 

Relative to the second instant message session, a second instant message user 
interface is rendered to the second instant message recipient, configured to project the 
personality, including the avatar, assigned to the second instant message recipient by 
the instant message sender (step 1135), similar to the user interface illustrated by FIG. 
1 . The personality may be projected in a similar manner to that described above with 
respect to step 1 125. However, the personality and avatar projected to the second 
instant message recipient may differ from the personality and avatar projected to the 
first instant message recipient described above in step 1 125. 

Referring to FIG. 14, an exemplary process 1400 enables an instant message 
sender to change a personality assigned to an instant message recipient. In process 
1400, a user selection of a new online persona, including an avatar, to be assigned to 
the instant message recipient is received (step 1405). The change may be received 
through an instant message chooser 1200, such as that discussed above with respect to 
FIG. 12, and may include choosing self-expression items and/or features and 
functionality using such as interface or may include "snagging" an online persona or 
an avatar of the buddy using such an interface. Snagging an avatar refers to the 
appropriation by the instant message sender of one or more personalization items, 
such as the avatar, used by the instant message recipient. Typically, all 
personalization items in the online persona of the instant message recipient are 
appropriated by the instant message sender when "snagging" an online persona. 

Next, the updated user interface for that instant message recipient is rendered 
based on the newly selected personality (step 1410). 

FIG. 15 illustrates an example process 1500 for modifying the appearance, or 
the behavior, of an avatar associated with an instant message sender to communicate 
an out-of-band message to an instant message recipient. The process may be 
performed by an instant messaging system, such as communications systems 1600, 
1700, and 1800 described with respect to FIGS. 16, 17, and 18, respectively. An out- 
of-band message refers to sending a message that communicates context out-of-band 
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— that is, conveying information independent of information conveyed directly 
through the text of the instant message itself sent to the recipient. Thus, the recipient 
views the appearance and behavior of the avatar to receive information that is not 
directly or explicitly conveyed in the instant message itself By way of example, an 
out-of-band communication may include information about the sender's setting, 
environment, activity or mood, which is not communicated and part of a text message 
exchanged by a sender and a recipient. 

The process 1500 begins with the instant messaging system monitoring the 
communications environment and sender's environment for an out-of-band 
communications indicator (step 1510). The indicator may be an indicator of the 
sender's setting, environment, activity, or mood that is not expressly conveyed in 
instant messages sent by the sender. For example, the out-of-band indicator may be 
an indication of time and date of the sender's location, which may be obtained from a 
clock application associated with the instant messaging system or with the sender's 
computer. The indicator may be an indication of the sender's physical location. The 
indicator may be an indication of an indication of weather conditions of the sender's 
location, which may be obtained from a weather reporting service, such as a web site 
that provides weather information for geographic locations. 

In addition, the indicator may indicate the activities of the sender that take 
place at, or near, the time when an instant message is sent. For example, the indicator 
may determine from the sender's computer other applications that are active at, or 
near, the time that an instant message is sent. For example, the indicator may detect 
that the sender is using a media-playing application to play music, so the avatar 
associated with the sender may appear to be wearing headphones to reflect that the 
sender is listening to music. As another example, the indicator may detect that the 
sender is working with a calculator application, so the avatar may appear to be 
wearing glasses to reflect that sender is working. 

The activities of the sender also maybe monitored through use of a camera 
focused on the sender. Visual information taken from the camera may be used to 
determine the activities and mood of the sender. For example, the location of points 
on the face of the sender may be determined from the visual information taken from 
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the camera. The position and motion of the facial points may be reflected in the 
avatar associated with the sender. Therefore, if the sender were to, for example, 
smile, then the avatar also smiles. 

The indicator of the sender's mood also may come from another device that is 
operable to determine the sender's mood and send an indication of mood to the 
sender's computer. For example, the sender may be wearing a device that monitors 
heart rate, and determines the sender's mood from the heart rate. For example, the 
device may conclude that the sender is agitated or excited when an elevated heart rate 
is detected. The device may send the indication of the sender's mood to the sender's 
computer for use with the sender's avatar. 

The instant messaging system makes a determination as to whether an out-of- 
band communications indicator has been detected (step 1520). When an out-of-band 
communications indicator is detected, the instant messaging system determines 
whether the avatar must be modified, customized, or animated to reflect the detected 
out-of-band communications indicator (step 1530); meanwhile or otherwise, the 
instant messaging system continues to monitor for out-of-band communications 
indicators (step 1510). To determine whether action is required, the instant messaging 
system may use a data table, list or file that includes out-of-band communications 
indicators and an associated action to be taken for each out-of-band communications 
indicator. Action may not be required for each out-of-band communications indicator 
detected. For example, action may only be required for some out-of-band 
communications indicators when an indicator has changed from a previous indicator 
setting. By way of example, the instant messaging system may periodically monitor 
the clock application to determine whether the setting associated with the sender is 
daytime or nighttime. Once the instant messaging system has taken action based on 
detecting an out-of-band communications indicator having a nighttime setting, the 
instant messaging system need not take action based on the detection of a subsequent 
nighttime setting indicator. The instant messaging system only takes action based on 
the nighttime setting after receiving an intervening out-of-band communications 
indicator for a daytime setting. 
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When action is required (step 1540), the appearance and/or behavior of the 
avatar is modified in response to the out-of-band communications indicator (step 
1550). 

In one example, when an out-of-band communications indicator shows that 
5 the sender is sending instant messages at night, the appearance of the avatar is 
modified to be dressed in pajamas. When the indicator shows that the sender is 
sending instant messages during a holiday period, the avatar may be dressed in a 
manner illustrative of the holiday. By way of example, the avatar may be dressed as 
Santa Claus during December, a pumpkin near Halloween, or Uncle Sam during early 
10 July. 

In another example, when the out-of-band indicator shows that the sender is at 
the office, the avatar may be dressed in business attire, such as a suit and a tie. The 
appearance of the avatar also may reflect the weather or general climate of the 
geographic location of the sender. For example, when the out-of-band 

15 communications indicator shows that it is raining at the location of the sender, the 
wallpaper of the avatar may be modified to include falling raindrops or display an 
open umbrella and/or the avatar may appear to wear a rain hat. 

As another example, when the out-of-band communications indicator shows 
that the sender is listening to music, the appearance of the avatar may be changed to 

20 show the avatar wearing headphones. Additionally or alternatively, the appearance of 
the avatar may be changed based on the type of music to which the sender is listening. 
When the indicator indicates that the sender is working (at the sender's work location 
or at another location), the avatar may appear in business attire, such as wearing a suit 
and a tie. As indicated by this example, different out-of-band communications 

25 indicators may trigger the same appearance of the avatar. In particular, both the out- 
of-band communications indicator of the sender being located at work and the out-of- 
band communications indicator of the sender performing a work activity causes the 
avatar to appear to be wearing a suit and tie. 

In yet another example of an out-of-band communications indicator, the mood 

30 of the sender may be so indicated. In such a case, the appearance of the avatar may be 
changed to reflect the indicated mood. For example, when the sender is sad, the 
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avatar may be modified to reflect the sad state of the sender, such as by animating the 
avatar to frown or cry. In another example, based on the detected activity of the 
sender, a frazzled, busy or pressed mood may be detected and the avatar animated to 
communicate such an emotional state. 
5 After the avatar appearance and/or behavior has been modified to reflect the 

out-of-band indicator (step 1550), the updated avatar, or an indication that the avatar 
has been updated, is communicated to the recipient (step 1560). Generally, the 
updated avatar, or indication that the avatar has been changed, is provided in 
association with the next instant message sent by the sender; however, this is not 

10 necessarily so in every implementation. In some implementations, a change in the 
avatar may be communicated to the recipient independently of the sending of a 
communication. Additionally or alternatively, when a buddy list of the instant 
message user interface includes a display of a sender's avatar, the change of the avatar 
appearance may be communicated to each buddy list that includes the sender. Thus, 

15 the recipient is made able to perceive the updated avatar, the behavior and/or 
appearance providing an out-of-band communication to the sender. 

FIG. 16 illustrates a communications system 1600 that includes an instant 
message sender system 1605 capable of communicating with an instant message host 
system 1610 through a communication link 1615. The communications system 1600 

20 also includes an instant message recipient system 1620 capable of communicating 
with the instant message host system 1610 through the communication link 1615. 
Using the communications system 1600, a user of the instant message sender system 
1605 is capable of exchanging communications with a user of the instant message 
recipient system 1620. The communications system 1600 is capable of animating 

25 avatars for use in self-expression by an instant message sender. 

In one implementation, any of the instant message sender system 1605, the 
instant message recipient system 1620, or the instant message host system 1610 may 
include one or more general-purpose computers, one or more special-purpose 
computers (e.g., devices specifically programmed to communicate with each other), 

30 or a combination of one or more general-purpose computers and one or more special- 
purpose computers. By way of example, the instant message sender system 1605 or 
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the instant message recipient system 1620 may be a personal computer or other type 
of personal computing device, such as a personal digital assistant or a mobile 
communications device. In some implementations, the instant message sender system 
1605 and/or the instant message recipient 1620 may be a mobile telephone that is 
capable of receiving instant messages. 

The instant message sender system 1605, the instant message recipient system 
1620 and the instant message host system 1610 may be arranged to operate within or 
in concert with one or more other systems, such as, for example, one or more LANs 
("Local Area Networks") and/or one or more WANs ("Wide Area Networks"). The 
communications link 1615 typically includes a delivery network (not shown) that 
provides direct or indirect communication between the instant message sender system 
1605 and the instant message host system 1610, irrespective of physical separation. 
Examples of a delivery network include the Internet, the World Wide Web, WANs, 
LANs 5 analog or digital wired and wireless telephone networks (e.g., Public Switched 
Telephone Network (PSTN), Integrated Services Digital Network (ISDN), and 
various implementations of a Digital Subscriber Line (DSL)), radio, television, cable, 
or satellite systems, and other delivery mechanisms for carrying data. The 
communications link 1615 may include communication pathways (not shown) that 
enable communications through the one or more delivery networks described above. 
Each of the communication pathways may include, for example, a wired, wireless, 
cable or satellite communication pathway. 

The instant message host system 1610 may support instant message services 
irrespective of an instant message sender's network or Internet access. Thus, the 
instant message host system 1610 may allow users to send and receive instant 
messages, regardless of whether they have access to any particular Internet service 
provider (ISP). The instant message host system 1610 also may support other 
services, including, for example, an account management service, a directory service, 
and a chat service. The instant message host system 1610 has an architecture that 
enables the devices (e.g., servers) within the instant message host system 1610 to 
communicate with each other. To transfer data, the instant message host system 1610 
employs one or more standard or proprietary instant message protocols. 
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To access the instant message host system 1610 to begin an instant message 
session in the implementation of FIG. 16, the instant message sender system 1605 
establishes a connection to the instant message host system 1610 over the 
communication link 1615. Once a connection to the instant message host system 
1610 has been established, the instant message sender system 1605 may directly or 
indirectly transmit data to and access content from the instant message host system 
1610. By accessing the instant message host system 1610, an instant message sender 
can use an instant message client application located on the instant message sender 
system 1605 to view whether particular users are online, view whether users may 
receive instant messages, exchange instant messages with particular instant message 
recipients, participate in group chat rooms, trade files such as pictures, invitations or 
documents, find other instant message recipients with similar interests, get customized 
information such as news and stock quotes, and search the Web. The instant message 
recipient system 1620 may be similarly manipulated to establish contemporaneous 
connection with instant message host system 1610. 

Furthermore, the instant message sender may view or perceive an avatar 
and/or other aspects of an online persona associated with the instant message sender 
prior to engaging in communications with an instant message recipient. For example, 
certain aspects of an instant message recipient selected personality, such as an avatar 
chosen by the instant message recipient, may be perceivable through the buddy list 
itself prior to engaging in communications. Other aspects of a selected personality 
chosen by an instant message recipient may be made perceivable upon opening of a 
communication window by the instant message sender for a particular instant message 
recipient but prior to initiation of communications. For example, animations of an 
avatar associated with the instant message sender only may be viewable in a 
communication window, such as the user interface 100 of FIG. 1. 

In one implementation, the instant messages sent between instant message 
sender system 1605 and instant message recipient system 1620 are routed through the 
instant message host system 1610. In another implementation, the instant messages 
sent between instant message sender system 1605 and instant message recipient 
system 1620 are routed through a third party server (not shown), and, in some cases, 
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are also routed through the instant message host system 1610. In yet another 
implementation, the instant messages are sent directly between instant message sender 
system 1605 and instant message recipient system 1620. 

The techniques, processes and concepts in this description may be 
implemented using communications system 1600. One or more of the processes may 
be implemented in a client/host context, a standalone or offline client context, or a 
combination thereof. For example, while some functions of one or more of the 
processes may be performed entirely by the instant message sender system 1605, 
other functions may be performed by host system 1610, or the collective operation of 
the instant message sender system 1605 and the host system 1610. By way of 
example, in process 300, the avatar of an instant message sender may be respectively 
selected and rendered by the standalone/offline device, and other aspects of the online 
persona of the instant message sender may be accessed or updated through a remote 
device in a non-client/host environment such as, for example, a LAN server serving 
an end user or a mainframe serving a terminal device. 

FIG. 17 illustrates a communications system 1700 that includes an instant 
message sender system 1605, an instant message host system 1610, a communication 
link 1615, and an instant message recipient 1620. System 1700 illustrates another 
possible implementation of the communications system 1600 of FIG. 16 that is used 
for animating avatars used for self-expression by an instant message sender 

In contrast to the depiction of the instant message host system 1610 in FIG. 16, 
the instant message host system 1610 includes a login server 1770 for enabling access 
by instant message senders and routing communications between the instant message 
sender system 1605 and other elements of the instant message host system 1610. The 
instant message host system 1610 also includes an instant message server 1790. To 
enable access to and facilitate interactions with the instant message host system 1610, 
the instant message sender system 1605 and the instant message recipient system 
1620 may include communication software, such as for example, an online service 
provider client application and/or an instant message client application. 

In one implementation, the instant message sender system 1605 establishes a 
connection to the login server 1770 in order to access the instant message host system 
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1610 and begin an instant message session. The login server 1770 typically 
determines whether the particular instant message sender is authorized to access the 
instant message host system 1610 by verifying the instant message sender's 
identification and password. If the instant message sender is authorized to access the 
instant message host system 1610, the login server 1770 usually employs a hashing 
technique on the instant message sender's screen name to identify a particular instant 
message server 1790 within the instant message host system 1610 for use during the 
instant message sender's session. The login server 1770 provides the instant message 
sender (e.g., instant message sender system 1605) with the Internet protocol ("IP") 
address of the instant message server 1790, gives the instant message sender system 
1605 an encrypted key, and breaks the connection. The instant message sender 
system 1605 then uses the IP address to establish a connection to the particular instant 
message server 1790 through the communications link 1615, and obtains access to the 
instant message server 1790 using the encrypted key. Typically, the instant message 
sender system 1 605 will be able to establish an open TCP connection to the instant 
message server 1790. The instant message recipient system 1620 establishes a 
comiection to the instant message host system 1610 in a similar manner. 

In one implementation, the instant message host system 1610 also includes a 
user profile server (not shown) connected to a database (not shown) for storing large 
amounts of user profile data. The user profile server may be used to enter, retrieve, 
edit, manipulate, or otherwise process user profile data. In one implementation, an 
instant message sender's profile data includes, for example, the instant message 
sender's screen name, buddy list, identified interests, and geographic location. The 
instant message sender's profile data may also include self-expression items selected 
by the instant message sender. The instant message sender may enter, edit and/or 
delete profile data using an installed instant message client application on the instant 
message sender system 1705 to interact with the user profile server. 

Because the instant message sender's data are stored in the instant message 
host system 1610, the instant message sender does not have to reenter or update such 
information in the event that the instant message sender accesses the instant message 
host system 1610 using a new or different instant message sender system 1605. 
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Accordingly, when an instant message sender accesses the instant message host 
system 1610, the instant message server can instruct the user profile server to retrieve 
the instant message sender's profile data from the database and to provide, for 
example, the instant message sender's self-expression items and buddy list to the 
instant message server. Alternatively, user profile data may be saved locally on the 
instant message sender system 1605. 

FIG 18 illustrates another example communications system 1800 capable of 
exchanging communications between users that project avatars for self-expression. 
The communications system 1800 includes an instant message sender system 1605, an 
instant message host system 1610, a communications link 1615 and an instant 
message recipient system 1620. 

The host system 1610 includes instant messaging server software 1832 routing 
communications between the instant message sender system 1605 and the instant 
message recipient system 1620. The instant messaging server software 1832 may 
make use of user profile data 1834. The user profile data 1834 includes indications of 
self-expression items selected by an instant message sender. The user profile data 
1834 also includes associations 1834a of avatar models with users (e.g., instant 
message senders). The user profile data 1834 may be stored, for example, in a 
database or another type of data collection, such as a series of extensible mark-up 
language (XMQL) files. In some implementations, the some portions of the user profile 
data 1834 may be stored in a database while other portions, such as associations 
1 834a of avatar models with users, may be stored in an XML file. 

One implementation of user profile data 1834 appears in the table below. In 
this example, the user profile data includes a screen name to uniquely identify the user 
for whom the user profile data applies, a password for signing-on to the instant 
message service, an avatar associated with the user, and an optional online persona. 
As shown in Table 1, a user may have multiple online personas, each associated with 
the same or a different avatar. 
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Screen Name 


Password 


Avatar 


Online Persona 


Robert_Appleby 


5846%JYNG 


Clam 


Work 


Robert_Appleby 


5846%JYNG 


Starfish 


Casual 


SusanMerit 


6748#474V 


Dolphin 




Bill_Smith 


JHG7868$0 


Starfish 


Casual 


Bill_Smith 


JHG7868$0 


Starfish 


Family 


Greg_Jones 


85775$#59 


Frog 





Table 1. 

The host system 1610 also includes an avatar model repository 1835 in which 
definitions of avatars that may be used in the instant message service are stored. In 
5 this implementation, an avatar definition includes an avatar model file, an avatar 
expression file for storing instructions to control the animation of the avatar, and 
wallpaper file. Thus, the avatar model repository 1835 includes avatar model files 
1836, avatar expression files 1837 and avatar wallpaper files 1838. 

The avatar model files 1836 define the appearance and animations of each of 
1 0 the avatars included in the avatar model repository 1 835. Each of the avatar model 
files 1836 defines the mesh, texture, lighting, sounds, and animations used to render 
an avatar. The mesh of a model file defines the form of the avatar, and the texture 
defines the image that covers the mesh. The mesh may be represented as a wire 
structure composed of a multitude of polygons that may be geometrically transformed 
15 to enable the display of an avatar to give the illusion of motion. In one 

implementation, lighting information of an avatar model file is in the form of a light 
map that portrays the effect of a light source on the avatar. The avatar model file also 
includes multiple animation identifiers. Each animation identifier identifies a 
particular animation that may be played for the avatar. For example, each animation 
20 identifier may identify one or more morph targets to describe display changes to 

transform the mesh of an avatar and display changes in the camera perspective used to 
display the avatar. 

When an instant message user projects an avatar self-expression, it may be 
desirable to define an avatar with multiple animations, including facial animations, to 
25 provide more types of animations usable by the user for self-expression. Additionally, 
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it may be desirable for facial animations to use a larger number of blend shapes, 
which may result in an avatar that, when rendered, may appears more expressive. A 
blend shape defines a portion of the avatar that may be animated and, in general, the 
more blend shapes that are defined for an animation model, the more expressive the 
image rendered from the animation model may appear. 

Various data management techniques may be used to implement the avatar 
model files. In some implementations, information to define an avatar may be stored 
in multiple avatar files that may be arranged in a hierarchical structure, such as a 
directory structure. In such a case, the association between a user and an avatar may 
be made through an association of the user with the root file in a directory of model 
files for the avatar. 

In one implementation, an avatar model file may include all possible 
appearances of an avatar, including different features and props that are available for 
user-customization. In such a case, user preferences for the appearance of the user's 
avatar include indications of which portions of the avatar model are to be displayed, 
and flags or other indications for each optional appearance feature or prop may be set 
to indicate whether the feature or prop is to be displayed. By way of example, an 
avatar model may be configured to display sunglasses, reading glasses, short hair and 
long hair. When a user configures the avatar to wear sunglasses and have long hair, 
the sunglasses feature and long hair features are turned on, the reading glasses and 
short hair features are turned off, and subsequent renderings of the avatar display the 
avatar having long hair and sunglasses. 

The avatar model repository 1835 also includes avatar expression files 1837. 
Each of the avatar expression files 1837 defines triggers that cause animations in the 
avatars. For example, each of the avatar expression files 1837 may define the text 
triggers that cause an of animation when the text trigger is identified in an instant 
message, as previously described with respect to FIGS. 3 and 4. An avatar expression 
file also may store associations between out-of-band communication indicators and 
animations that are played when a particular out-of-band communication indicator is 
detected. One example of a portion of an avatar expression file is depicted in Table 2 
below. 
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ANIMATION TYPE 


TRIGGERSS 


OUT-OF-BAND 
COMMUNICATION 
INDIC Al ORIS 


SMILE 


:) :-) Nice 




GONE AWAY 


bye brb cu gtg cul bbl gg 
b4n ttyl ttfii 


Instraction to shut down 
computer 


SLEEP 


zzz tired sleepy snooze 


Time is between 1 a.m. and 
5 a.m. 


WINTER CLOTHES 




Date is between November 
1 and March 1 


RAIN 




Weather is rain 


SNOW 




Weather is snow 



Table 2. 

In some implementations, the association between a particular animation for a 
particular animation identifier is indirectly determined for a particular trigger or out- 
of-band communication indicator. For example, a particular trigger or out-of-band 
communication indicator may be associated with a type of animation (such as a smile, 
gone away, or sleep), as illustrated in Table 2. A type of animation also may be 
associated with a particular animation identifier included in a particular avatar model 
file, as illustrated in Table 3 below. In such a case, to play an animation based on a 
particular trigger or out-of-band communication indicator, the type of animation is 
identified, the animation identifier associated with the identified type of animation is 
determined, and the animation identified by the animation identifier is played. Other 
computer animation and programming techniques also may be used. For example, 
each avatar may use the same animation identifier for a particular animation type 
rather than including the avatar name shown in the table. Alternatively or 
additionally, the association of animation types and animation identifiers maybe 
stored separately for each avatar. 



ANIMATION TYPE 


ANIMATION 
IDENTIFIER 


AVATAR NAME 


SMILE 


1304505 


DOLPHIN 


SMILE 


5858483 


FROG 


GONE AWAY 


4848484 


DOLPHIN 



Table 3. 
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The avatar expression files 1837 also include information to define the way 
that an avatar responds to an animation of another avatar, hi one implementation, an 
avatar expression file includes pairs of animation identifiers. One of the animation 
identifiers in each pair identifies a type of animation that, when the type of animation 
5 is played for one avatar, triggers an animation that is identified by the other animation 
identifier in the pair in another avatar. In this manner, the avatar expression file may 
define an animation played for an instant message recipient's avatar in response to an 
animation played by an instant message sender's avatar. In some implementations, 
the avatar expression files 1837 may include XML files having elements for defining 
10 the text triggers for each of the animations of the corresponding avatar and elements 
for defining the animations that are played in response to animations seen from other 
avatars. 

The avatar model repository 1835 also includes avatar wallpaper files 1838 
that define the wallpaper over which an avatar is drawn. The wallpaper may be 

15 defined using the same or different type of file structure as the avatar model files. For 
example, an avatar model file may be defined as an animation model file that is 
generated and playable using animation software from Viewpoint Corporation of New 
York, New York, whereas the wallpaper files may be in the form of a Macromedia 
Flash file that is generated and playable using animation software available from 

20 Macromedia, Inc. of San Francisco, California. When wallpaper includes animated 
objects that are triggered by an instant message, an out-of-band communication 
indicator or an animation of an avatar, the avatar wallpaper files 1838 also may 
include one or more triggers that are associated with the wallpaper animation. 

Each of the instant message sender system 1605 and the instant message 

25 recipient system 1620 includes an instant messaging communication application 1807 
or 1827 that capable of exchanging instant messages over the communications link 
1615 with the instant message host system 1610. The instant messaging 
communication application 1807 or 1827 also maybe referred to as an instant 
messaging client. 

30 Each of the instant message sender system 1605 and the instant message 

recipient system 1620 also includes avatar data 1808 or 1828. The avatar data 1808 
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or 1828 include avatar model files 1808a or 1828a, avatar expression files 1808b or 
1828b, and avatar wallpaper files 1808c or 1828c for the avatars that are capable of 
being rendered by the instant message sender system 1605 or the instant message 
recipient system 1620, respectively. The avatar data 1808 or 1828 maybe stored in 
5 persistent storage, transient storage, or stored using a combination of persistent and 
transient storage. When all or some of the avatar data 1808 or 1828 is stored in 
persistent storage, it may be useful to associate a predetermined date on which some 
or all of the avatar data 1808 or 1828 is to be deleted from the instant message sender 
system 1605 or the instant message recipient system 1620, respectively. In this 

10 manner, avatar data may be removed from the instant message sender system 1605 or 
the instant message recipient system 1620 after the data has resided on the instant 
message sender system 1605 or 1620 for a predetermined period of time and 
presumably is no longer needed. This may help reduce the amount of storage space 
used for instant messaging on the instant message sender system 1605 or the instant 

1 5 message recipient system 1 620. 

hi one implementation, the avatar data 1808 or 1828 is installed on the instant 
message sender system 1605 or the instant message recipient system 1620, 
respectively, with the instant messaging client software installed on the instant 
message sender system 1605 or the instant message recipient system 1620. In another 

20 implementation, the avatar data 1808 or 1828 is transmitted to the instant message 
sender system 1605 or the instant message recipient system 1620, respectively, from 
the avatar model repository 1835 of the instant messaging host system 1610. In yet 
another implementation, the avatar data 1 808 or 1 828 is copied from a source 
unrelated to instant messaging and stored for use as instant messaging avatars on the 

25 instant message sender system 1605 or the instant message recipient system 1620, 
respectively. In yet another implementation, the avatar data 1808 or 1828 is sent to 
the instant message sender system 1605 or the instant message recipient system 1620, 
respectively, with or incident to instant messages sent to the instant message sender 
system 1605 or the instant message recipient system 1620. The avatar data sent with 

30 an instant message corresponds to the instant message sender that sent the message. 
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The avatar expression files 1808b or 1828b are used to determine when an 
avatar is to be rendered on the instant message sender system 1605 or the instant 
message recipient 1620, respectively. To render an avatar, one of the avatar model 
files 1808a is displayed on the two-dimensional display of the instant messaging 
system 1605 or 1620 by an avatar model player 1809 or 1829, respectively In one 
implementation, the avatar model player 1808 or 1829 is an animation player by 
Viewpoint Corporation. More particularly, the processor of the instant messaging 
system 1605 or 1620 calls the avatar model player 1809 or 1829 and identifies an 
animation included in one of the avatar model files 1808a or 1828a. In general, the 
animation is identified by an animation identifier in the avatar model file. The avatar 
model player 1809 or 1829 then accesses the avatar model file and plays the identified 
animation. 

hi many cases multiple animations may be played based on a single trigger or 
out-of-band communications indicator. This may occur, for example, when one avatar 
reacts to an animation of another avatar that is animated based on a text trigger, as 
described previously with respect to FIG. 6. 

In the system 1800, four animations may be separately initiated based on a text 
trigger in one instant message. An instant message sender projecting a self-expressive 
avatar uses instant message sender system 1605 to sends a text message to an instant 
message recipient using instant message recipient system 1620. The instant message 
recipient also is projecting a self-expressive avatar. The display of the instant 
message sender system 1605 shows an instant message user interface, such as user 
interface 100 of FIG 1, as does the display of instant message recipient system 1620. 
Thus, the sender avatar is shown on both the instant message sender system 1605 and 
the instant message recipient system 1620, as is the recipient avatar. The instant 
message sent from instant message sender system includes a text trigger that causes 
the animation of the sender avatar on the instant message sender system 1605 and the 
sender avatar on the instant message recipient system 1620. In response to the 
animation of the sender avatar, the recipient avatar is animated, as described 
previously with respect to FIG. 6. The reactive animation of the recipient avatar 
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occurs in both the recipient avatar displayed on the instant message sender system 
1605 and the recipient avatar displayed on the instant message recipient system 1620. 

In some implementations, an instant messaging user is permitted to customize 
one or more of the animation triggers or out-of-band communications indicators for 
5 avatar animations, wallpaper displayed for an avatar, triggers or out-of-band 

communications indicators for animating objects of the wallpaper, and the appearance 
of the avatar. In one implementation, a copy of an avatar model file, an expression 
file or a wallpaper file is made and the modifications of the user are stored in the copy 
of the avatar model file, an expression file or a wallpaper file. The copy that includes 

10 the modification is then associated with the user. Alternatively or additionally, only 
the changes — that is, the differences between the avatar before the modifications and 
the avatar after the modifications are made - are stored. In some implementations, 
different versions of the same avatar may be stored and associated with a user. This 
may enable a user to modify an avatar, use the modified avatar for a period of time, 

15 and then return to using a previous version of the avatar that does not include the 
modification. 

In some implementations, the avatars from which a user may choose may be 
limited by the instant message service provider. This may be referred to as a closed 
implementation or a locked-down implementation, hi such an implementation, the 

20 animations and triggers associated with each avatar within the closed set of avatars 
may be preconfigured. In some closed implementations, the user may customize the 
animations and/or triggers of a chosen avatar. For example, a user may include a 
favorite video clip as an animation of an avatar, and the avatar may be configured to 
play the video clip after certain text triggers appear in the messages sent by the user. 

25 In other closed implementations, the user is also prevented from adding animations to 
an avatar. 

In some implementations, the set of avatars from which a user may choose is 
not limited by the instant message service provider, and the user may use an avatar 
other than an avatar provided by the instant message service provider. This may be 
30 referred to as an open implementation or an unlocked implementation. For example, 
an avatar usable in an instant message service may be created by a user using 
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animation software provided by the instant message service provider, off-the-shelf 
computer animation software, or software tools provided by a third-party that are 
specialized for the creating avatars compatible with one or more instant message 
services. 

5 In some implementations, a combination of a closed-implementation and an 

open-implementation may be used. For example, an instant message service provider 
may limit the selection by users who are minors to a set of predetermined avatars 
provided by the instant message service provider while permitting users who are 
adults to use an avatar other than an avatar available from the instant message service 
1 0 provider. 

In some implementations, the avatars from which a user may select may be 
limited based on a user characteristic, such as age. As illustrated in Table 4 below 
and using the avatars shown in FIG. 8 only as an example, a user who is under the age 
of 10 may be limited to one group of avatars. A user who is between 10 and 18 may 
15 be limited to a different group of avatars, some of which are the same as the avatars 
selectable by users under the age of 10. A user who is 18 or older may select from 
any avatar available from the instant message provider service. 



USER AGE 


AVATAR NAMES 


Less than age 1 0 


Sheep, Cow, Dolphin, Happy, Starfish, Dragon, 
Polly 


Age 10 to 18 


Sheep, Cow, Dolphin, Happy, Starfish, Dragon, 
Polly, Robot, Frog, T-Rex, Parrot, Boxing Glove, 
Snake, Monster, Parrot 


Age 1 8 or older 


Sheep, Cow, Dolphin, Happy, Starfish, Dragon, 
Polly, Robot, Frog, T-Rex, Parrot, Boxing Glove, 
Snake, Monster, Parrot, Lips, Pirate Skull 



Table 4. 

20 Instant messaging programs typically allow instant message senders to 

communicate in real-time with each other in a variety of ways. For example, many 
instant messaging programs allow instant message senders to send text as an instant 
message, to transfer files, and to communicate by voice. Examples of instant 
messaging communication applications include AIM (America Online Instant 
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Messenger), AOL (America Online) Buddy List and Instant Messages which is an 
aspect of many client communication applications provided by AOL 5 Yahoo 
Messenger, MSN Messenger, and ICQ, among others. Although discussed above 
primarily with respect to instant message applications, other implementations are 
contemplated for providing similar functionality in platforms and online applications. 
For example, the techniques and concepts may be applied to an animated avatar that 
acts as an information assistant to convey news, weather, and other information to a 
user of a computer system or a computing device. 

The techniques and concepts generally have been described in the context of 
an instant messaging system that uses an instant messaging host system to facilitate 
the instant messaging communication between instant message senders and instant 
message recipients. Other instant message implementations are contemplated, such as 
an instant message service in which instant messages are exchanged directly between 
an instant message sender system and an instant message recipient system. 

For example, although the examples above are given in an instant message 
context, other communications systems with similar attributes may be used. For 
example, multiple personalities may be used in a chat room or in e-mail 
communications. Also, the user interface may be a viewable interface, an audible 
interface, a tactile interface, or a combination of these. 

Other implementations are within the scope of the following claims. 



66 



WO 2004/079530 



PCT/US2004/006284 



WHAT IS CLAIMED IS: 

1 . A graphical user interface configured for presentation on a display 
device and comprising: 
5 a sender portion that displays a sender avatar capable of displaying multiple 

animations; 

a message compose area capable of displaying text included in the message 
sent from the sender to the recipient; and 

communication controls, at least one communication control being operable to 
10 receive an indication that the message displayed in the message compose area is to be 
sent from the sender to the recipient, 

wherein the sender avatar is animated in response to a trigger related to 
content of a message sent from a sender to a recipient. 

15 2. The graphical user interface of claim 1 wherein the instant message 

sender display comprises a recipient portion that displays a recipient avatar capable of 
displaying multiple animations in response to a trigger related to content of a message 
sent from a sender to a recipient, a message history area capable of displaying the 
content of multiple messages sent between the sender and the recipient and 

20 identifying an identity associated with the recipient. 

3. The graphical user interface of claim 2 wherein the recipient avatar is 
animated in response to an animation of the sender avatar. 

25 4. The graphical user interface of claim 1 wherein the graphical user 

interface comprises a contact list display for displaying potential recipients. 

5. The graphical user interface of claim 4 wherein the contact list display 
indicates whether each potential recipient is available to receive a message. 

30 
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6. The graphical user interface of claim 4 wherein the potential recipients 
are grouped and associated with an indication of a group identity. 

>. 

7. The graphical user interface of claim 4, wherein a potential recipient 
displayed on the contact list is associated with a potential recipient avatar, further 
comprising: 

displaying the potential recipient avatar on the contact list in association with 
an identity of the potential recipient; and 

animating the potential recipient avatar on the contact list in response to 
animation of the potential recipient avatar displayed elsewhere. 

8. The graphical user interface of claim 7 wherein the animation of the 
potential recipient avatar on the contact list comprises an animation that is 
substantially similar to the animation of the potential recipient avatar displayed 
elsewhere. 

9. The graphical user interface of claim 7 wherein the animation of the 
potential recipient avatar on the contact list comprises an animation that is different 
than the animation of the potential recipient avatar displayed elsewhere. 

10. The graphical user interface of claim 7 wherein the animation of the 
potential recipient avatar on the contact list comprises an animation that is 
representative of the animation of the potential recipient avatar displayed elsewhere. 

1 1 . The graphical user interface of claim 1 wherein graphical user interface 
is used for an instant messaging communication session. 

12. The graphical user interface of claim 1 wherein the trigger comprises a 
portion of the text of the message. 
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13. The graphical user interface of claim 1 wherein the trigger comprises 
all of the text of the message. 

14. The graphical user interface of claim 1 wherein appearance or 
animation of the sender avatar indicates an environmental condition associated with 
the sender. 

1 5 . The graphical user interface of claim 1 wherein appearance or 
animation of the sender avatar indicates a personality characteristic associated with 
the sender. 

16. The graphical user interface of claim 1 wherein appearance or 
animation of the sender avatar indicates an emotional state associated with the sender. 

17. The graphical user interface of claim 1 wherein appearance or 
animation of the sender avatar indicates a setting characteristic associated with the 
sender. 

18. The graphical user interface of claim 1 wherein appearance or 
animation of the sender avatar indicates an activity associated with the sender. 

19. The graphical user interface of claim 1 wherein the sender avatar is 
animated in response to the passing of a predetermined amount of time during which 
the sender does not communicate a message to the recipient. 

20. The graphical user interface of claim 1 wherein the sender avatar is 
animated in response to the passing of a predetermined amount of time during which 
the sender does not use a computing device that is used by the sender to communicate 
with the recipient in the communications session. 
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21 . The graphical user interface of claim 1 wherein the avatar animation 
used as the communication conduit comprises a breakout animation that involves 
displaying avatar outside of normal display space occupied by the avatar. 

5 22. The graphical user interface of claim 1 wherein the sender avatar is 

animated to produce sounds used for verbal communication. 

23. The graphical user interface of claims 1-22 wherein the graphical user 
interface is generated by an executing computer program product. 

10 

24. An apparatus for generating a graphical user interface configured for 
presentation on a display device, the apparatus comprising a processor connected to 
one or more input components and one or more output components, wherein the 
processor is configured to : 

15 generate a sender portion that displays a sender avatar capable of displaying 

multiple animations; 

generate a message compose area capable of displaying text included in the 
message sent from the sender to the recipient; and 

generate communication controls, at least one communication control being 
20 operable to receive an indication that the message displayed in the message compose 
area is to be sent from the sender to the recipient, 

wherein the sender avatar is animated in response to a trigger related to 
content of a message sent from a sender to a recipient. 

25 25. A method for communicating, the method comprising: 

graphically representing, with an avatar capable of being animated, a first user 
in a communication session involving the first user and a second user; 

communicating a message between the first user and the second user, the 
message conveying explicit information from the first user to the second user; and 
30 communicating out-of-band information to the second user using a change in 

the avatar appearance or avatar animation as a communication conduit, 
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wherein the out-of-band communication comprises a communication that is 
related to a context of the first user and that differs from the information conveyed in 
the message sent between the first user and the second user. 

26. The method of claim 25 wherein the communication session is an 
instant messaging communication session. 

27. The method of claim 25 wherein the avatar comprises a facial 
animation that does not include a body having an ear or a leg. 

28. The method of claim 25 wherein the avatar comprises a facial 
animation, including a neck, that does not include a body having an ear or a leg. 

29. The method of claim 25 wherein the out-of-band information 
comprises information indicating an environmental condition associated with the first 
user. 

30. The method of claim 29 wherein the environmental condition 
comprises an environmental condition related to weather occurring in a geographic 
location near the first user. 

3 1 . The method of claim 25 wherein the out-of-band information 
comprises information indicating a personality characteristic associated with the first 
user. 

32. The method of claim 25 wherein the out-of-band information 
comprises information indicating an emotional state associated with the first user. 

33. The method of claim 25 wherein the out-of-band information 
comprises information indicating a setting characteristic associated with the first user. 
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34. The method of claim 33 wherein the setting characteristic comprises a 
characteristic related to time of day of the first user. 

35. The method of claim 33 wherein the setting characteristic comprises a 
5 characteristic related to time of year. 

36. The method of claim 35 wherein the time of year comprises a holiday. 

37. The method of claim 35 wherein the time of year comprises a season 
10 wherein the season is one of spring, summer, fall or winter. 

38. The method of claim 33 wherein the setting characteristic comprises a 
characteristic associated with a work setting. 

15 39. The method of claim 33 wherein the setting characteristic comprises a 

characteristic associated with a recreation setting. 

40. The method of claim 39 wherein the recreation setting comprises a 
beach setting or a tropical setting. 

20 

41. The method of claim 39 wherein the recreation setting comprises a 
winter sport setting. 

42. The method of claim 25 wherein out-of-band information comprises 
25 information related to a mood of the first user. 

43. The method of claim 42 wherein the mood of the first user comprises 
one of happy, sad or angry. 

30 44. The method of claim 25 wherein out-of-band information comprises 

information associated with an activity of the first user. 
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45. The method of claim 44 wherein the activity is being performed by the 
first user at substantially the same time that the out-of-band message is communicated 
from the first user to the second user. 

i 

46. The method of claim 45 wherein the activity comprises one of working 
or listening to music. 

47. The method of claim 29 wherein out-of-band information comprises 
information conveying that the first user has muted sounds associated with the avatar. 

48. The method of claim 25 further comprising triggering, based on the 
information conveyed in the message from the first user to the second user, an 
animation of the avatar to convey the out-of-band information from the first user to 
the second user. 

49. The method of claim 48 wherein the trigger comprises a portion of 

text. 

50. The method of claim 48 wherein the trigger comprises all of the text of 
the message. 

5 1 . The method of claim 48 wherein the trigger comprises an audio portion 
of the message. 

52. The method of claim 48 wherein the trigger comprises passing a 
predetermined amount of time during which the first user does not communicate a 
message to the second user. 

53. The method of claim 48 wherein the trigger comprises passing a 
predetermined amount of time during which the first user does not use a computing 
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device that is used by the first user to communicate with the second user in the 
communication session. 

54. The method of claim 25 wherein the avatar animation used as the 
communication conduit comprises a facial expression of the avatar. 

55. The method of claim 25 wherein the avatar animation used as the 
communication conduit comprises a gesture made by a hand of the avatar or a gesture 
made by an arm of the avatar. 

56. The method of claim 25 wherein the avatar animation used as the 
communication conduit comprises movement of a body of the avatar. 

57. The method of claim 25 wherein the avatar animation used as the 
communication conduit comprises sounds made by the avatar. 

58. The method of claim 57 wherein at least some of the sounds comprise 
a voice based on a voice of the first user. 

59= The method of claim 25 wherein the avatar animation used as the 
communication conduit comprises a breakout animation that involves displaying 
avatar outside of normal display space occupied by the avatar. 

60. The method of claim 59 wherein the breakout animation comprises 
telescoping the avatar. 

61. The method of claim 59 wherein the breakout animation comprises 
resizing the avatar. 

62. The method of claim 59 wherein the breakout animation comprises 
repositioning the avatar. 
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63. The method of claim 25 further comprising 

providing the first user with multiple preconfigured avatars having associated 
preselected animations; and 

enabling the first user to select a particular avatar to represent the user in the 
communications session. 

64. The method of claim 63 further comprising persistently associating the 
first user with the selected avatar to represent the first user in subsequent 
communication sessions. 

65. The method of claim 63 further comprising enabling the first user to 
modify the appearance of the avatar. 

66. The method of claim 65 wherein enabling the first user to modify the 
appearance of the avatar comprises enabling the first user to use a slide bar to indicate 
a particular modification of a particular feature of the avatar. 

67. The method of claim 65 wherein enabling the first user to modify the 
appearance of the avatar comprises enabling the first user to modify appearance of the 
avatar to reflect a characteristic of the first user. 

68. The method of claim 67 wherein the characteristic of the first user 
comprises one of age, gender, hair color, eye color, or a facial feature. 

69. The method of claim 65 wherein enabling the first user to modify the 
appearance of the avatar comprises enabling the first user to modify appearance of the 
avatar by adding, changing or deleting a prop displayed with the avatar. 

70. The method of claim 69 wherein the prop comprises one of eyeglasses, 
sunglasses, a hat, or earrings. 
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71 . The method of claim 25 further comprising enabling the first user to 
modify a trigger used to cause an animation of the avatar. 

72. The method of claim 71 wherein the trigger comprises text included in 
the message sent from the first user to the second user. 

73. The method of claim 25 further comprising animating the avatar for 
use as an information assistant to convey information to the first user. 

74. The method of claim 25 further comprising enabling use of the avatar 
by an application other than a communications application. 

75. The method of claim 74 wherein enabling use of the avatar by an 
application other than a communications application comprises enabling use of the 
avatar in an online journal. 

76. The method of claim 25 further comprising displaying a depiction of 
the avatar in the form that is substantially similar to a trading card. 

77. The method of claim 76 wherein the trading card depiction of the 
avatar comprises a trading card depiction of the avatar that includes characteristics 
associated with the first user. 

78. The method of claims 25-77 wherein the processes are performed by a 
computer program that is configured to communicate and that is embodied on a 
computer— readable medium or propagated signal. 

79. An apparatus for communicating, the apparatus comprising a processor 
connected to a storage device and one or more input/output devices, wherein the 
processor is configured to: 
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graphically represent, with an avatar capable of being animated, a first user in 
a communication session involving the first user and a second user; 

communicate a message between the first user and the second user, the 
message conveying explicit information from the first user to the second user; and 

communicate out-of-band information to the second user using a change in the 
avatar appearance or avatar animation as a communication conduit, 

wherein the out-of-band communication comprises a communication that is 
related to a context of the first user and that differs from the information conveyed in 
the message sent between the first user and the second user. 

80. A computer-implemented method for enabling perception of multiple 
online personas in an instant messaging communications session, the method 
comprising: 

identifying at least two identities within a communications environment to 
whom messages may be directed; and 

enabling a first persona of a user to be projected to a first of the identities 
while enabling a second persona of the same user to be concurrently projected to a 
second of the identities,, 

wherein: 

the first and second personas each comprise an avatar capable of being 
animated, and 

the first persona and the second persona differ. 

8 1 . The method of claim 80 wherein the first persona differs from the 
second persona such that first persona invokes a different avatar than an avatar 
invoked by the second persona. 

82. The method of claim 80 wherein: 
the first persona invokes a first avatar, 

the second persona invokes a second avatar, 

the first avatar and the second avatar are the same avatar, and 
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an animation associated with the first avatar is different from animations 
associated with the second avatar. 

83. The method of claim 80 wherein: 
the first persona invokes a first avatar, 

the second persona invokes a second avatar, 
the first avatar and the second avatar are the same avatar, and 
an appearance associated with the first avatar is different from appearances 
associated with the second avatar. 

84. The method of claim 80 wherein at least one of the avatars comprises 
an avatar that is associated with multiple sounds. 

85. The method of claim 80 wherein at least one of the avatars comprises 
an avatar capable of being animated persona based on text of a message sent in the 
instant message communications session. 

86. The method of claim 80 wherein at least one of the avatars comprises 
an avatar capable of being animated to send an out-of-band communication. 

87. The method of claim 80 further comprising associating the first 
persona with a first group of identities so that the first persona is projected in 
communications sessions with members of the first group of identities. 

88. The method of claim 87 further comprising associating the second 
persona with a second group of identities so that the second persona is projected in 
communications sessions with members of the second group of identities. 

89. The method of claim 80 further comprising associating a persona with 
the first of the identities and associating a different persona with a group of the 
identities with which the first of the identities is associated, wherein the first persona 
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projected to the first of the identities comprises an amalgamation of the persona 
associated with the first of the identities and the different persona associated with the 
group of the identities. 

90. The method of claim 89 wherein the persona associated with the first 
of the identities overrides the different persona associated with the group of the 
identities to the extent a conflict exists. 

91 . The method of claims 80-90 where in the processes are performed by a 
computer program configured to enable perception of multiple online personas in an 
instant messaging communications session and that is embodied on a computer- 
readable medium or propagated signal. 

92. An apparatus for enabling perception of multiple online personas in an 
instant messaging communications session, the apparatus comprising a processor 
connected to a storage device and one or more input/output devices, wherein the 
processor is configured to: 

identify at least two identities within a communications environment to whom 
messages may be directed; and 

enable a first persona of a user to be projected to a first of the identities while 
enabling a second persona of the same user to be concurrently projected to a second 
of the identities, 

wherein: 

the first and second personas each comprise an avatar capable of being 
animated, and 

the first persona and the second persona differ. 

93. The apparatus of claim 92 wherein the first persona differs from the 
second persona such that first persona invokes a different avatar than an avatar 
invoked by the second persona. 
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94. The apparatus of claim 92 wherein: 
the first persona invokes a first avatar, 

the second persona invokes a second avatar, 
the first avatar and the second avatar are the same avatar, and 
5 an animation associated with the first avatar is different from animations 

associated with the second avatar. 

95 . The apparatus of claim 92 wherein: 
the first persona invokes a first avatar, 

10 the second persona invokes a second avatar, 

the first avatar and the second avatar are the same avatar, and 
an appearance associated with the first avatar is different from appearances 
associated with the second avatar. 

15 96. The apparatus of claim 92 wherein at least one of the avatars comprises 

an avatar capable of being animated persona based on text of a message sent in the 
instant message communications session. 

97. The apparatus of claim 92 wherein at least one of the avatars comprises 
20 an avatar capable of being animated to send an out-of-band communication. 

98. A computer-implemented method for enabling perception of multiple 
online personas in an instant messaging communications session, the method 
comprising: 

25 rendering, on an instant messaging recipient system, an instant messaging 

application user interface for an instant messaging communications session involving 
at least one potential instant messaging recipient and a single potential instant 
messaging sender; 

sending a message that includes a text message and a persona selected among 
30 multiple possible personas associated with the instant messaging sender to be 
displayed by the potential instant messaging recipient when displaying the text 
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message, the selected persona comprising a collection of one or more self-expression 
items and a sender avatar capable of being animated; and 

rendering the selected persona at the potential instant messaging recipient 
system when rendering another portion of the message. 

5 

99. The method of claim 98 wherein the sender persona is selected by the 
instant messaging sender from the multiple possible personas associated with the 
instant messaging sender. 

10 1 00. The method of claim 98 wherein the persona is rendered before 

communications are initiated by the potential instant messaging sender. 

101. The method of claim 98 wherein the persona is rendered after 
communications are initiated by the potential instant messaging sender. 

15 

102. The method of claim 98 in which self-expression items comprise one 
or more of a wallpaper, an emoticon, and a sound. 

103. The method of claim 98 further comprising defining one or more 
20 personas. 

104. The method of claim 103 further comprising: 

assigning a first persona to a first potential instant messaging recipient so that 
the first persona is thereafter automatically invoked and projected, in an instant 
25 messaging communications session involving the first potential instant messaging 
recipient; and 

assigning a second persona to a second potential instant messaging recipient 
so that the second persona is thereafter automatically invoked and projected, in an 
instant messaging communications session involving the second potential instant 
30 messaging recipient, wherein the second persona is at least partially distinguishable 
from the first persona. 
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1 05 . The method of claim 1 04 further comprising: 

assigning a first persona to a first group of potential instant messaging 
recipients so that the first persona is thereafter automatically invoked and projected in 
5 an instant messaging communications session involving a member of the first group 
of potential instant messaging recipients; and 

assigning a second persona to a second potential instant messaging recipient 
so that the second persona is thereafter automatically invoked and projected, in an 
instant messaging communications session involving the second potential instant 
10 messaging recipient, wherein the second persona is at least partially distinguishable 
from the first persona. 

106. The method of claim 98 further comprising disabling use of one of the 
multiple personas. 

15 

107. The method of claim 98 wherein disabling use of one of the multiple 
personas comprises disabling use of one of the multiple personas based on the instant 
messaging recipient. 

20 108. The method of claim 98 wherein: 

one of the multiple personas comprise a work persona associated with 
presence of the instant messaging sender at a work location associated with the instant 
messaging sender, and 

one of the multiple personas comprise a home persona associated with 
25 presence of the instant messaging sender at home, 

the method further comprising: 

determining whether the instant messaging sender is at home or at the 
work location; 

in response to a determination that the instant messaging sender is at 
30 home, selecting the home persona for use in the instant messaging 

communications session; and 
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in response to a determination that the instant messaging sender is at 
the work location, selecting the work persona for use in the instant messaging 
communications session. 

109. The method of claim 98 further comprising selecting a persona to be 
displayed by the potential instant messaging recipient based on time of day. 

110. The method of claim 98 further comprising selecting a persona to be 
displayed by the potential instant messaging recipient based on day of week. 

111. The method of claim 98 further comprising selecting a persona to be 
displayed by the potential instant messaging recipient based on a group of potential 
instant messaging recipients that are associated with the potential instant messaging 
recipient. 

112. The method of claim 98 wherein at least some of characteristics of a 
persona may be transparent to the instant messaging sender. 

1 1 3. The method of claim 98 wherein the sender avatar is animated to send 
an out-of-band communication from the instant messaging sender to the potential 
instant messaging recipient. 

114. The method of claim 113 wherein the out-of-band communication 
comprises a communication indicating an environmental condition associated with the 
instant messaging sender. 

115. The method of claim 114 wherein the environmental condition 
comprises an enviromnental condition related to weather occurring in a geographic 
location near the instant messaging sender. 
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116. The method of claim 113 wherein the out-of-band communication 
comprises a communication indicating a personality characteristic associated with the 
instant messaging sender. 

5 117. The method of claim 113 wherein the out-of-band communication 

comprises a communication indicating an emotional state associated with the instant 
messaging sender. 

118. The method of claim 113 wherein the out-of-band communication 
10 comprises a communication indicating a setting characteristic associated with the 

instant messaging sender. 

119. The method of claim 118 wherein the setting characteristic comprises a 
characteristic related to time of day of the instant messaging sender. 

15 

120. The method of claim 113 wherein the setting characteristic comprises a 
characteristic related to time of year. 

121 . The method of claim 120 wherein the time of year comprises a 
20 holiday. 

122. The method of claim 120 wherein the time of year comprises a season 
wherein the season is one of spring, summer, fall or winter. 

25 123. The method of claim 113 wherein the setting characteristic comprises a 

characteristic associated with a work setting. 

124. The method of claim 113 wherein the setting characteristic comprises a 
characteristic associated with a recreation setting. 

30 
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125. The method of claim 124 wherein the recreation setting comprises a 
beach setting or a tropical setting. 

126. The method of claim 125 wherein the recreation setting comprises a 
winter sport setting. 

127. The method of claims 98-126 wherein the processes are performed by 
a computer program that is configured to enable perception of multiple online 
personas in an instant messaging communications session and that is embodied on a 
computer-readable medium or propagated signal. 

128. An apparatus for enabling perception of multiple online personas in an 
instant messaging communications session, the apparatus comprising a processor 
connected to a storage device and one or more input/output devices, wherein the 
processor is configured to: 

render, on an instant messaging recipient system, an instant messaging 
application user interface for an instant messaging communications session involving 
at least one potential instant messaging recipient and a single potential instant 
messaging sender; 

send a message that includes a text message and a persona selected among 
multiple possible personas associated with the instant messaging sender to be 
displayed by the potential instant messaging recipient when displaying the text 
message, the selected persona comprising a collection of one or more self-expression 
items and a sender avatar capable of being animated; and 

render the selected persona at the potential instant messaging recipient system 
when rendering another portion of the message. 

129. A computer-implemented method for using an avatar to communicate, 
the method comprising: 

representing a user graphically using an avatar capable of being animated, 
wherein the avatar is associated with multiple animations and multiple features of 
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appearance that represent a pattern of characteristics representing a personality of the 
avatar. 

130. The method of claim 129 wherein the avatar is associated with a 
5 description that identifies the personality of the avatar. 

131. The method of claim 129 wherein the personality of the avatar includes 
at least some characteristics that are distinct of at least some characteristics of a 
personality of the user. 

10 

132. The method of claim 129 further comprising: 

graphically representing a second user with a second avatar capable of being 
animated wherein the second avatar is associated with multiple animations and 
multiple features of appearance that represent a pattern of characteristics representing 
15 a personality of the second avatar, 

wherein: 

the personality of the second avatar includes at least some characteristics that 
are distinct of at least some characteristics of the personality of the first avatar, and 

communication messages are being sent between the first user and the second 

20 user. 

133. The method of claims 73-76 wherein the processes are performed by a 
computer that is configured to use an avatar to communicate and that is embodied on 
a computer-readable medium or propagated signal. 

25 

134. An apparatus for using an avatar to communicate, the apparatus 
comprising a processor connected to a storage device and one or more input/output 
devices, wherein the processor is configured to: 

represent a user graphically using an avatar capable of being animated, 
30 wherein the avatar is associated with multiple animations and multiple features of 
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appearance that represent a pattern of characteristics representing a personality of the 
avatar. 

135. A apparatus for using an avatar to communicate, the apparatus 
5 comprising: 

means for representing a user graphically using an avatar capable of being 
animated, wherein the avatar is associated with multiple animations and multiple 
features of appearance that represent a pattern of characteristics representing a 
personality of the avatar. 

10 

136. A computer-implemented method for animating a first avatar based on 
perceived animation of a second avatar, the method comprising: 

graphically representing a first user with a first avatar capable of being 
animated; 

15 graphically representing a second user with a second avatar capable of being 

animated wherein communication messages are being sent between the first user and 
the second user; 

receiving an indication of an animation of the first avatar; and 
in response to and based on the received indication of the animation, 
20 animating the second avatar. 

137. The method of claim 136 wherein receiving the indication of an 
animation comprises receiving an indication of any type of animation of the first 
avatar. 

25 

138. The method of claim 136 wherein receiving the indication of an 
animation comprises receiving an indication of a particular animation of multiple 
possible animations of the first avatar. 

30 139. The method of claim 136 further comprising animating the first avatar 

in response to and based on the animation of the second avatar. 
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140. The method of claim 136 wherein the first avatar is animated in 
response to a particular portion of a message sent between the first user and the 
second user. 

5 

141. The method of claim 140 wherein the first avatar is animated in 
response to a particular portion of a message sent from the first user to the second 
user. 

10 142. The method of claim 140 wherein the first avatar is animated in 

response to a particular portion of a message sent to the first user from the second 
user. 

143. The method of claim 136 wherein the first avatar is animated to send 
15 an out-of-band communication from the first user to the second user. 

144. The method of claim 143 wherein the out-of-band communication 
comprises a communication indicating an environmental condition associated with the 
first user. 

20 

145. The method of claim 144 wherein the environmental condition 
comprises an environmental condition related to weather occurring in a geographic 
location near the first user. 

25 146. The method of claim 143 wherein the out-of-band communication 

comprises a communication indicating a personality characteristic associated with the 
first user. 

147. The method of claim 143 wherein the out-of-band communication 
30 comprises a communication indicating an emotional state associated with the first 
user. 
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148. The method of claim 143 wherein the out-of-band communication 
comprises a communication indicating a setting characteristic associated with the first 
user. 

5 

149. The method of claim 148 wherein the setting characteristic comprises a 
characteristic related to time of day of the first user. 

150. The method of claim 147 wherein the setting characteristic comprises a 
1 0 characteristic related to time of year. 

151. The method of claim 150 wherein the time of year comprises a 
holiday. 

15 152. The method of claim 150 wherein the time of year comprises a season 

wherein the season is one of spring, summer, fall or winter. 

153. The method of claim 147 wherein the setting characteristic comprises a 

characteristic associated with a work setting. 

20 

154. The method of claim 147 wherein the setting characteristic comprises a 
characteristic associated with a recreation setting. 

155. The method of claim 154 wherein the recreation setting comprises a 
25 beach setting or a tropical setting. 

156. The method of claim 154 wherein the recreation setting comprises a 
winter sport setting. 



30 



157. The method of claims 136-156 wherein the processes are performed by 
a computer program that is configured to animate a first avatar based on perceived 
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animation of a second avatar and that is embodied on a computer-readable medium or 
propagated signal. 

158. An apparatus for animating a first avatar based on perceived animation 
of a second avatar, the apparatus comprising a processor connected to a storage device 
and one or more input/output devices, wherein the processor is configured to: 

graphically represent a first user with a first avatar capable of being animated; 

graphically represent a second user with a second avatar capable of being 
animated wherein communication messages are being sent between the first user and 
the second user; 

receive an indication of an animation of the first avatar; and 

animate the second avatar in response to and based on the received indication 
of the animation. 

159. The apparatus of claim 158 wherein the processor is configured to 
receive an indication of any type of animation of the first avatar. 

160. The apparatus of claim 158 wherein the processor is configured to 
receive an indication of a particular animation of multiple possible animations of the 
first avatar. 

161. The apparatus of claim 158 wherein the processor is further configured 
to animate the first avatar in response to and based on the animation of the second 
avatar. 

162. The apparatus of claim 158 wherein the processor is further configured 
to animate the first avatar in response to a particular portion of a message sent 
between the first user and the second user. 
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163. The apparatus of claim 158 wherein the processor is further configured 
animate the first avatar to send an out-of-band communication from the first user to 
the second user. 
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